Neural Mean Discrepancy for Efficient Out-of-Distribution Detection
  Various approaches have been proposed for out-of-distribution (OOD) detection
by augmenting models, input examples, training sets, and optimization
objectives. Deviating from existing work, we have a simple hypothesis that
standard off-the-shelf models may already contain sufficient information about
the training set distribution which can be leveraged for reliable OOD
detection. Our empirical study on validating this hypothesis, which measures
the model activation's mean for OOD and in-distribution (ID) mini-batches,
surprisingly finds that activation means of OOD mini-batches consistently
deviate more from those of the training data. In addition, training data's
activation means can be computed offline efficiently or retrieved from batch
normalization layers as a 'free lunch'. Based upon this observation, we propose
a novel metric called Neural Mean Discrepancy (NMD), which compares neural
means of the input examples and training data. Leveraging the simplicity of
NMD, we propose an efficient OOD detector that computes neural means by a
standard forward pass followed by a lightweight classifier. Extensive
experiments show that NMD outperforms state-of-the-art OOD approaches across
multiple datasets and model architectures in terms of both detection accuracy
and computational cost.
