Diffusion-Based Representation Learning
  Score-based methods represented as stochastic differential equations on a
continuous time domain have recently proven successful as a non-adversarial
generative model. Training such models relies on denoising score matching,
which can be seen as multi-scale denoising autoencoders. Here, we augment the
denoising score-matching framework to enable representation learning without
any supervised signal. GANs and VAEs learn representations by directly
transforming latent codes to data samples. In contrast, the introduced
diffusion based representation learning relies on a new formulation of the
denoising score-matching objective and thus encodes information needed for
denoising. We illustrate how this difference allows for manual control of the
level of details encoded in the representation. Using the same approach, we
propose to learn an infinite-dimensional latent code which achieves
improvements of state-of-the-art models on semi-supervised image
classification. As a side contribution, we show how adversarial training in
score-based models can improve sample quality and improve sampling speed using
a new approximation of the prior at smaller noise scales.
