Model Pruning Based on Quantified Similarity of Feature Maps
  A high-accuracy CNN is often accompanied by huge parameters, which are
usually stored in the high-dimensional tensors. However, there are few methods
can figure out the redundant information of the parameters stored in the
high-dimensional tensors, which leads to the lack of theoretical guidance for
the compression of CNNs. In this paper, we propose a novel theory to find
redundant information in three dimensional tensors, namely Quantified
Similarity of Feature Maps (QSFM), and use this theory to prune convolutional
neural networks to enhance the inference speed. Our method belongs to filter
pruning, which can be implemented without using any special libraries. We
perform our method not only on common convolution layers but also on special
convolution layers, such as depthwise separable convolution layers. The
experiments prove that QSFM can find the redundant information in the neural
network effectively. Without any fine-tuning operation, QSFM can compress
ResNet-56 on CIFAR-10 significantly (48.27% FLOPs and 57.90% parameters
reduction) with only a loss of 0.54% in the top-1 accuracy. QSFM also prunes
ResNet-56, VGG-16 and MobileNetV2 with fine-tuning operation, which also shows
excellent results.
