Feature discriminativity estimation in CNNs for transfer learning
  The purpose of feature extraction on convolutional neural networks is to
reuse deep representations learnt for a pre-trained model to solve a new,
potentially unrelated problem. However, raw feature extraction from all layers
is unfeasible given the massive size of these networks. Recently, a supervised
method using complexity reduction was proposed, resulting in significant
improvements in performance for transfer learning tasks. This approach first
computes the discriminative power of features, and then discretises them using
thresholds computed for the task. In this paper, we analyse the behaviour of
these thresholds, with the purpose of finding a methodology for their
estimation. After a comprehensive study, we find a very strong correlation
between problem size and threshold value, with coefficient of determination
above 90%. These results allow us to propose a unified model for threshold
estimation, with potential application to transfer learning tasks.
