Holistic Deep Learning
  There is much interest in deep learning to solve challenges that arise in
applying neural network models in real-world environments. In particular, three
areas have received considerable attention: adversarial robustness, parameter
sparsity, and output stability. Despite numerous attempts on solving these
problems independently, there is very little work addressing the challenges
simultaneously. In this paper, we address this problem of constructing holistic
deep learning models by proposing a novel formulation that solves these issues
in combination. Real-world experiments on both tabular and MNIST dataset show
that our formulation is able to simultaneously improve the accuracy,
robustness, stability, and sparsity over traditional deep learning models among
many others.
