Fundamental Issues Regarding Uncertainties in Artificial Neural Networks
  Artificial Neural Networks (ANNs) implement a specific form of multi-variate
extrapolation and will generate an output for any input pattern, even when
there is no similar training pattern. Extrapolations are not necessarily to be
trusted, and in order to support safety critical systems, we require such
systems to give an indication of the training sample related uncertainty
associated with their output. Some readers may think that this is a well known
issue which is already covered by the basic principles of pattern recognition.
We will explain below how this is not the case and how the conventional
(Likelihood estimate of) conditional probability of classification does not
correctly assess this uncertainty. We provide a discussion of the standard
interpretations of this problem and show how a quantitative approach based upon
long standing methods can be practically applied. The methods are illustrated
on the task of early diagnosis of dementing diseases using Magnetic Resonance
Imaging.
