Ensemble-based Uncertainty Quantification: Bayesian versus Credal
  Inference
  The idea to distinguish and quantify two important types of uncertainty,
often referred to as aleatoric and epistemic, has received increasing attention
in machine learning research in the last couple of years. In this paper, we
consider ensemble-based approaches to uncertainty quantification.
Distinguishing between different types of uncertainty-aware learning
algorithms, we specifically focus on Bayesian methods and approaches based on
so-called credal sets, which naturally suggest themselves from an ensemble
learning point of view. For both approaches, we address the question of how to
quantify aleatoric and epistemic uncertainty. The effectiveness of
corresponding measures is evaluated and compared in an empirical study on
classification with a reject option.
