Pruning Deep Convolutional Neural Networks Architectures with Evolution
  Strategy
  Currently, Deep Convolutional Neural Networks (DCNNs) are used to solve all
kinds of problems in the field of machine learning and artificial intelligence
due to their learning and adaptation capabilities. However, most successful
DCNN models have a high computational complexity making them difficult to
deploy on mobile or embedded platforms. This problem has prompted many
researchers to develop algorithms and approaches to help reduce the
computational complexity of such models. One of them is called filter pruning,
where convolution filters are eliminated to reduce the number of parameters
and, consequently, the computational complexity of the given model. In the
present work, we propose a novel algorithm to perform filter pruning by using
Multi-Objective Evolution Strategy (ES) algorithm, called DeepPruningES. Our
approach avoids the need for using any knowledge during the pruning procedure
and helps decision-makers by returning three pruned CNN models with different
trade-offs between performance and computational complexity. We show that
DeepPruningES can significantly reduce a model's computational complexity by
testing it on three DCNN architectures: Convolutional Neural Networks (CNNs),
Residual Neural Networks (ResNets), and Densely Connected Neural Networks
(DenseNets).
