Intrinsic uncertainties and where to find them
  We introduce a framework for uncertainty estimation that both describes and
extends many existing methods. We consider typical hyperparameters involved in
classical training as random variables and marginalise them out to capture
various sources of uncertainty in the parameter space. We investigate which
forms and combinations of marginalisation are most useful from a practical
point of view on standard benchmarking data sets. Moreover, we discuss how some
marginalisations may produce reliable estimates of uncertainty without the need
for extensive hyperparameter tuning and/or large-scale ensembling.
