An Inexact Projected Gradient Method with Rounding and Lifting by
  Nonlinear Programming for Solving Rank-One Semidefinite Relaxation of
  Polynomial Optimization
  We consider solving high-order semidefinite programming (SDP) relaxations of
nonconvex polynomial optimization problems (POPs) that often admit degenerate
rank-one optimal solutions. Instead of solving the SDP alone, we propose a new
algorithmic framework that blends local search using the nonconvex POP into
global descent using the convex SDP. In particular, we first design a globally
convergent inexact projected gradient method (iPGM) for solving the SDP that
serves as the backbone of our framework. We then accelerate iPGM by taking
long, but safeguarded, rank-one steps generated by fast nonlinear programming
algorithms. We prove that the new framework is still globally convergent for
solving the SDP. To solve the iPGM subproblem of projecting a given point onto
the feasible set of the SDP, we design a two-phase algorithm with phase one
using a symmetric Gauss-Seidel based accelerated proximal gradient method
(sGS-APG) to generate a good initial point, and phase two using a modified
limited-memory BFGS (L-BFGS) method to obtain an accurate solution. We analyze
the convergence for both phases and establish a novel global convergence result
for the modified L-BFGS that does not require the objective function to be
twice continuously differentiable. We conduct numerical experiments for solving
second-order SDP relaxations arising from a diverse set of POPs. Our framework
demonstrates state-of-the-art efficiency, scalability, and robustness in
solving degenerate rank-one SDPs to high accuracy, even in the presence of
millions of equality constraints.
