Reliable Probability Intervals For Classification Using Inductive Venn
  Predictors Based on Distance Learning
  Deep neural networks are frequently used by autonomous systems for their
ability to learn complex, non-linear data patterns and make accurate
predictions in dynamic environments. However, their use as black boxes
introduces risks as the confidence in each prediction is unknown. Different
frameworks have been proposed to compute accurate confidence measures along
with the predictions but at the same time introduce a number of limitations
like execution time overhead or inability to be used with high-dimensional
data. In this paper, we use the Inductive Venn Predictors framework for
computing probability intervals regarding the correctness of each prediction in
real-time. We propose taxonomies based on distance metric learning to compute
informative probability intervals in applications involving high-dimensional
inputs. Empirical evaluation on image classification and botnet attacks
detection in Internet-of-Things (IoT) applications demonstrates improved
accuracy and calibration. The proposed method is computationally efficient, and
therefore, can be used in real-time.
