paper-with-me

홈 › Papers

An Inexact Projected Gradient Method with Rounding and Lifting by Nonlinear Programming for Solving Rank-One Semidefinite Relaxation of Polynomial Optimization

2021-05-28 · Heng Yang, Ling Liang, Luca Carlone, Kim-Chuan Toh

We consider solving high-order semidefinite programming (SDP) relaxations of nonconvex polynomial optimization problems (POPs) that often admit degenerate rank-one optimal solutions. Instead of solving the SDP alone, we propose a new algorithmic framework that blends local search using the nonconvex POP into global descent using the convex SDP. In particular, we first design a globally convergent inexact projected gradient method (iPGM) for solving the SDP that serves as the backbone of our framework. We then accelerate iPGM by taking long, but safeguarded, rank-one steps generated by fast nonlinear programming algorithms. We prove that the new framework is still globally convergent for solving the SDP. To solve the iPGM subproblem of projecting a given point onto the feasible set of the SDP, we design a two-phase algorithm with phase one using a symmetric Gauss-Seidel based accelerated proximal gradient method (sGS-APG) to generate a good initial point, and phase two using a modified limited-memory BFGS (L-BFGS) method to obtain an accurate solution. We analyze the convergence for both phases and establish a novel global convergence result for the modified L-BFGS that does not require the objective function to be twice continuously differentiable. We conduct numerical experiments for solving second-order SDP relaxations arising from a diverse set of POPs. Our framework demonstrates state-of-the-art efficiency, scalability, and robustness in solving degenerate rank-one SDPs to high accuracy, even in the presence of millions of equality constraints.

📄 PDF Abstract BibTeX arXiv:2105.14033

Code (1)

MIT-SPARK/STRIDE 공식 구현

Similar Papers 제목 키워드 기반

A Provably Convergent and Practical Algorithm for Gromov--Wasserstein Optimal Transport

2026-05-05 · Ling Liang, Lei Yang arxiv

Gromov--Wasserstein optimal transport (GWOT) aligns metric measure spaces by matching their within-domain relational structures, but large-scale GWOT remains challenging because its objective is nonconvex and projection …

Inexact Primal-Dual Gradient Projection Methods for Nonlinear Optimization on Convex Set

2019-11-18 · Fan Zhang, Hao Wang, Jiashan Wang, Kai Yang

In this paper, we propose a novel primal-dual inexact gradient projection method for nonlinear optimization problems with convex-set constraint. This method only needs inexact computation of the projections onto the conv…

On the Convergence Rates of Policy Gradient Methods

2022-01-19 · Lin Xiao

We consider infinite-horizon discounted Markov decision problems with finite state and action spaces and study the convergence rates of the projected policy gradient method and a general class of policy mirror descent me…

Policy Gradient Methods

Proximally Guided Stochastic Subgradient Method for Nonsmooth, Nonconvex Problems

2017-07-12 · Damek Davis, Benjamin Grimmer

In this paper, we introduce a stochastic projected subgradient method for weakly convex (i.e., uniformly prox-regular) nonsmooth, nonconvex functions---a wide class of functions which includes the additive and convex com…

Inexact bilevel stochastic gradient methods for constrained and unconstrained lower-level problems

2021-10-01 · Tommaso Giovannelli, Griffin Dean Kent, Luis Nunes Vicente

Two-level stochastic optimization formulations have become instrumental in a number of machine learning contexts such as continual learning, neural architecture search, adversarial learning, and hyperparameter tuning. Pr…

BIG-bench Machine LearningBilevel OptimizationContinual LearningNeural Architecture Search+1