Shared Representational Geometry Across Neural Networks
  Different neural networks trained on the same dataset often learn similar
input-output mappings with very different weights. Is there some correspondence
between these neural network solutions? For linear networks, it has been shown
that different instances of the same network architecture encode the same
representational similarity matrix, and their neural activity patterns are
connected by orthogonal transformations. However, it is unclear if this holds
for non-linear networks. Using a shared response model, we show that different
neural networks encode the same input examples as different orthogonal
transformations of an underlying shared representation. We test this claim
using both standard convolutional neural networks and residual networks on
CIFAR10 and CIFAR100.
