Coded ResNeXt: a network for designing disentangled information paths
  To avoid treating neural networks as highly complex black boxes, the deep
learning research community has tried to build interpretable models allowing
humans to understand the decisions taken by the model. Unfortunately, the focus
is mostly on manipulating only the very high-level features associated with the
last layers. In this work, we look at neural network architectures for
classification in a more general way and introduce an algorithm which defines
before the training the paths of the network through which the per-class
information flows. We show that using our algorithm we can extract a lighter
single-purpose binary classifier for a particular class by removing the
parameters that do not participate in the predefined information path of that
class, which is approximately 60% of the total parameters. Notably, leveraging
coding theory to design the information paths enables us to use intermediate
network layers for making early predictions without having to evaluate the full
network. We demonstrate that a slightly modified ResNeXt model, trained with
our algorithm, can achieve higher classification accuracy on CIFAR-10/100 and
ImageNet than the original ResNeXt, while having all the aforementioned
properties.
