Stochastic Normalizing Flows
  We introduce stochastic normalizing flows, an extension of continuous
normalizing flows for maximum likelihood estimation and variational inference
(VI) using stochastic differential equations (SDEs). Using the theory of rough
paths, the underlying Brownian motion is treated as a latent variable and
approximated, enabling efficient training of neural SDEs as random neural
ordinary differential equations. These SDEs can be used for constructing
efficient Markov chains to sample from the underlying distribution of a given
dataset. Furthermore, by considering families of targeted SDEs with prescribed
stationary distribution, we can apply VI to the optimization of hyperparameters
in stochastic MCMC.
