Stochastic and Private Nonconvex Outlier-Robust PCA
  We develop theoretically guaranteed stochastic methods for outlier-robust
PCA. Outlier-robust PCA seeks an underlying low-dimensional linear subspace
from a dataset that is corrupted with outliers. We are able to show that our
methods, which involve stochastic geodesic gradient descent over the
Grassmannian manifold, converge and recover an underlying subspace in various
regimes through the development of a novel convergence analysis. The main
application of this method is an effective differentially private algorithm for
outlier-robust PCA that uses a Gaussian noise mechanism within the stochastic
gradient method. Our results emphasize the advantages of the nonconvex methods
over another convex approach to solving this problem in the differentially
private setting. Experiments on synthetic and stylized data verify these
results.
