Theoretical guarantees for sampling and inference in generative models
  with latent diffusions
  We introduce and study a class of probabilistic generative models, where the
latent object is a finite-dimensional diffusion process on a finite time
interval and the observed variable is drawn conditionally on the terminal point
of the diffusion. We make the following contributions:
  We provide a unified viewpoint on both sampling and variational inference in
such generative models through the lens of stochastic control.
  We quantify the expressiveness of diffusion-based generative models.
Specifically, we show that one can efficiently sample from a wide class of
terminal target distributions by choosing the drift of the latent diffusion
from the class of multilayer feedforward neural nets, with the accuracy of
sampling measured by the Kullback-Leibler divergence to the target
distribution.
  Finally, we present and analyze a scheme for unbiased simulation of
generative models with latent diffusions and provide bounds on the variance of
the resulting estimators. This scheme can be implemented as a deep generative
model with a random number of layers.
