Gradient Descent Converges to Minimizers
  We show that gradient descent converges to a local minimizer, almost surely with random initialization. This is proved by applying the Stable Manifold Theorem from dynamical systems theory. 
Jason D. Lee, Max Simchowitz, Michael I. Jordan, Benjamin Recht
stat.ML cs.LG math.OC