Natural Posterior Network: Deep Bayesian Uncertainty for Exponential
  Family Distributions
  Uncertainty awareness is crucial to develop reliable machine learning models.
In this work, we propose the Natural Posterior Network (NatPN) for fast and
high-quality uncertainty estimation for any task where the target distribution
belongs to the exponential family. Thus, NatPN finds application for both
classification and general regression settings. Unlike many previous
approaches, NatPN does not require out-of-distribution (OOD) data at training
time. Instead, it leverages Normalizing Flows to fit a single density on a
learned low-dimensional and task-dependent latent space. For any input sample,
NatPN uses the predicted likelihood to perform a Bayesian update over the
target distribution. Theoretically, NatPN assigns high uncertainty far away
from training data. Empirically, our extensive experiments on calibration and
OOD detection show that NatPN delivers highly competitive performance for
classification, regression and count prediction tasks.
