Aggregated Gradient Langevin Dynamics
  In this paper, we explore a general Aggregated Gradient Langevin Dynamics
framework (AGLD) for the Markov Chain Monte Carlo (MCMC) sampling. We
investigate the nonasymptotic convergence of AGLD with a unified analysis for
different data accessing (e.g. random access, cyclic access and random
reshuffle) and snapshot updating strategies, under convex and nonconvex
settings respectively. It is the first time that bounds for I/O friendly
strategies such as cyclic access and random reshuffle have been established in
the MCMC literature. The theoretic results also indicate that methods in AGLD
possess the merits of both the low per-iteration computational complexity and
the short mixture time. Empirical studies demonstrate that our framework allows
to derive novel schemes to generate high-quality samples for large-scale
Bayesian posterior learning tasks.
