Robustified Multivariate Regression and Classification Using
  Distributionally Robust Optimization under the Wasserstein Metric
  We develop Distributionally Robust Optimization (DRO) formulations for
Multivariate Linear Regression (MLR) and Multiclass Logistic Regression (MLG)
when both the covariates and responses/labels may be contaminated by outliers.
The DRO framework uses a probabilistic ambiguity set defined as a ball of
distributions that are close to the empirical distribution of the training set
in the sense of the Wasserstein metric. We relax the DRO formulation into a
regularized learning problem whose regularizer is a norm of the coefficient
matrix. We establish out-of-sample performance guarantees for the solutions to
our model, offering insights on the role of the regularizer in controlling the
prediction error. Experimental results show that our approach improves the
predictive error by 7% -- 37% for MLR, and a metric of robustness by 100% for
MLG.
