On Numerosity of Deep Neural Networks
  Recently, a provocative claim was published that number sense spontaneously
emerges in a deep neural network trained merely for visual object recognition.
This has, if true, far reaching significance to the fields of machine learning
and cognitive science alike. In this paper, we prove the above claim to be
unfortunately incorrect. The statistical analysis to support the claim is
flawed in that the sample set used to identify number-aware neurons is too
small, compared to the huge number of neurons in the object recognition
network. By this flawed analysis one could mistakenly identify number-sensing
neurons in any randomly initialized deep neural networks that are not trained
at all. With the above critique we ask the question what if a deep
convolutional neural network is carefully trained for numerosity? Our findings
are mixed. Even after being trained with number-depicting images, the deep
learning approach still has difficulties to acquire the abstract concept of
numbers, a cognitive task that preschoolers perform with ease. But on the other
hand, we do find some encouraging evidences suggesting that deep neural
networks are more robust to distribution shift for small numbers than for large
numbers.
