LEAN: graph-based pruning for convolutional neural networks by
  extracting longest chains
  Convolutional neural networks (CNNs) have proven to be highly successful at a
range of image-to-image tasks. CNNs can be prohibitively computationally
expensive for real time use, which can limit their applicability in practice.
Model pruning can improve computational efficiency by sparsifying trained
networks. Common methods for pruning CNNs determine what convolutional filters
to remove by ranking filters on an individual basis. However, filters are not
independent, as CNNs consist of chains of convolutions, which can result in
sub-optimal filter selection.
  We propose a novel pruning method, LongEst-chAiN (LEAN) pruning, which takes
the interdependency between the convolution operations into account. We propose
to prune CNNs by using graph-based algorithms to select relevant chains of
convolutions. A CNN is interpreted as a graph, with the operator norm of each
operator as distance metric for the edges. LEAN pruning iteratively extracts
the highest value path from the graph to keep. In our experiments, we test LEAN
pruning for several image-to-image tasks, including the well-known CamVid
dataset, and a real-world dynamic X-ray CT dataset. When pruning CNNs with
LEAN, we achieve a higher accuracy than pruning filters individually, and
different pruned substructures emerge.
