Function-Specific Mixing Times and Concentration Away from Equilibrium
  Slow mixing is the central hurdle when working with Markov chains, especially
those used for Monte Carlo approximations (MCMC). In many applications, it is
only of interest to estimate the stationary expectations of a small set of
functions, and so the usual definition of mixing based on total variation
convergence may be too conservative. Accordingly, we introduce
function-specific analogs of mixing times and spectral gaps, and use them to
prove Hoeffding-like function-specific concentration inequalities. These
results show that it is possible for empirical expectations of functions to
concentrate long before the underlying chain has mixed in the classical sense,
and we show that the concentration rates we achieve are optimal up to
constants. We use our techniques to derive confidence intervals that are
sharper than those implied by both classical Markov chain Hoeffding bounds and
Berry-Esseen-corrected CLT bounds. For applications that require testing,
rather than point estimation, we show similar improvements over recent
sequential testing results for MCMC. We conclude by applying our framework to
real data examples of MCMC, providing evidence that our theory is both accurate
and relevant to practice.
