Theoretical Analysis of Adversarial Learning: A Minimax Approach
  Here we propose a general theoretical method for analyzing the risk bound in
the presence of adversaries. Specifically, we try to fit the adversarial
learning problem into the minimax framework. We first show that the original
adversarial learning problem can be reduced to a minimax statistical learning
problem by introducing a transport map between distributions. Then, we prove a
new risk bound for this minimax problem in terms of covering numbers under a
weak version of Lipschitz condition. Our method can be applied to multi-class
classification problems and commonly used loss functions such as the hinge and
ramp losses. As some illustrative examples, we derive the adversarial risk
bounds for SVMs, deep neural networks, and PCA, and our bounds have two
data-dependent terms, which can be optimized for achieving adversarial
robustness.
