Implicit Autoencoders
  In this paper, we describe the "implicit autoencoder" (IAE), a generative
autoencoder in which both the generative path and the recognition path are
parametrized by implicit distributions. We use two generative adversarial
networks to define the reconstruction and the regularization cost functions of
the implicit autoencoder, and derive the learning rules based on
maximum-likelihood learning. Using implicit distributions allows us to learn
more expressive posterior and conditional likelihood distributions for the
autoencoder. Learning an expressive conditional likelihood distribution enables
the latent code to only capture the abstract and high-level information of the
data, while the remaining low-level information is captured by the implicit
conditional likelihood distribution. We show the applications of implicit
autoencoders in disentangling content and style information, clustering,
semi-supervised classification, learning expressive variational distributions,
and multimodal image-to-image translation from unpaired data.
