Effective, Efficient and Robust Neural Architecture Search
  Recent advances in adversarial attacks show the vulnerability of deep neural
networks searched by Neural Architecture Search (NAS). Although NAS methods can
find network architectures with the state-of-the-art performance, the
adversarial robustness and resource constraint are often ignored in NAS. To
solve this problem, we propose an Effective, Efficient, and Robust Neural
Architecture Search (E2RNAS) method to search a neural network architecture by
taking the performance, robustness, and resource constraint into consideration.
The objective function of the proposed E2RNAS method is formulated as a
bi-level multi-objective optimization problem with the upper-level problem as a
multi-objective optimization problem, which is different from existing NAS
methods. To solve the proposed objective function, we integrate the
multiple-gradient descent algorithm, a widely studied gradient-based
multi-objective optimization algorithm, with the bi-level optimization.
Experiments on benchmark datasets show that the proposed E2RNAS method can find
adversarially robust architectures with optimized model size and comparable
classification accuracy.
