Compressing Representations for Embedded Deep Learning
  Despite recent advances in architectures for mobile devices, deep learning
computational requirements remains prohibitive for most embedded devices. To
address that issue, we envision sharing the computational costs of inference
between local devices and the cloud, taking advantage of the compression
performed by the first layers of the networks to reduce communication costs.
Inference in such distributed setting would allow new applications, but
requires balancing a triple trade-off between computation cost, communication
bandwidth, and model accuracy. We explore that trade-off by studying the
compressibility of representations at different stages of MobileNetV2, showing
those results agree with theoretical intuitions about deep learning, and that
an optimal splitting layer for network can be found with a simple PCA-based
compression scheme.
