The Perturbed Prox-Preconditioned SPIDER algorithm for EM-based large
  scale learning
  Incremental Expectation Maximization (EM) algorithms were introduced to
design EM for the large scale learning framework by avoiding the full data set
to be processed at each iteration. Nevertheless, these algorithms all assume
that the conditional expectations of the sufficient statistics are explicit. In
this paper, we propose a novel algorithm named Perturbed Prox-Preconditioned
SPIDER (3P-SPIDER), which builds on the Stochastic Path Integral Differential
EstimatoR EM (SPIDER-EM) algorithm. The 3P-SPIDER algorithm addresses many
intractabilities of the E-step of EM; it also deals with non-smooth
regularization and convex constraint set. Numerical experiments show that
3P-SPIDER outperforms other incremental EM methods and discuss the role of some
design parameters.
