Interpreting Rate-Distortion of Variational Autoencoder and Using Model
  Uncertainty for Anomaly Detection
  Building a scalable machine learning system for unsupervised anomaly
detection via representation learning is highly desirable. One of the prevalent
methods is using a reconstruction error from variational autoencoder (VAE) via
maximizing the evidence lower bound. We revisit VAE from the perspective of
information theory to provide some theoretical foundations on using the
reconstruction error, and finally arrive at a simpler and more effective model
for anomaly detection. In addition, to enhance the effectiveness of detecting
anomalies, we incorporate a practical model uncertainty measure into the
metric. We show empirically the competitive performance of our approach on
benchmark datasets.
