paper-with-me

Papers

A Newton-CG based barrier method for finding a second-order stationary point of nonconvex conic optimization with complexity guarantees

2022-07-12 · Chuan He, Zhaosong Lu

In this paper we consider finding an approximate second-order stationary point (SOSP) of nonconvex conic optimization that minimizes a twice differentiable function over the intersection of an affine subspace and a convex cone. In particular, we propose a Newton-conjugate gradient (Newton-CG) based barrier method for finding an $(\epsilon,\sqrt{\epsilon})$-SOSP of this problem. Our method is not only implementable, but also achieves an iteration complexity of ${\cal O}(\epsilon^{-3/2})$, which matches the best known iteration complexity of second-order methods for finding an $(\epsilon,\sqrt{\epsilon})$-SOSP of unconstrained nonconvex optimization. The operation complexity, consisting of ${\cal O}(\epsilon^{-3/2})$ Cholesky factorizations and $\widetilde{\cal O}(\epsilon^{-3/2}\min\{n,\epsilon^{-1/4}\})$ other fundamental operations, is also established for our method.

📄 PDF Abstract BibTeX arXiv:2207.05697

Code (0)

등록된 구현이 없습니다.

Tasks

Second-order methods

Similar Papers 제목 키워드 기반

A Newton-CG based barrier-augmented Lagrangian method for general nonconvex conic optimization

2023-01-10 · Chuan He, Heng Huang, Zhaosong Lu

In this paper we consider finding an approximate second-order stationary point (SOSP) of general nonconvex conic optimization that minimizes a twice differentiable function subject to nonlinear equality constraints and a…

Newton-CG methods for nonconvex unconstrained optimization with Hölder continuous Hessian

2023-11-22 · Chuan He, Heng Huang, Zhaosong Lu

In this paper we consider a nonconvex unconstrained optimization problem minimizing a twice differentiable objective function with H\"older continuous Hessian. Specifically, we first propose a Newton-conjugate gradient (…

A Newton-CG based augmented Lagrangian method for finding a second-order stationary point of nonconvex equality constrained optimization with complexity guarantees

2023-01-09 · Chuan He, Zhaosong Lu, Ting Kei Pong

In this paper we consider finding a second-order stationary point (SOSP) of nonconvex equality constrained optimization when a nearly feasible point is known. In particular, we first propose a new Newton-CG method for fi…

Finding Second-Order Stationary Points in Nonconvex-Strongly-Concave Minimax Optimization

2021-10-10 · Luo Luo, YuJun Li, Cheng Chen

We study the smooth minimax optimization problem $\min_{\bf x}\max_{\bf y} f({\bf x},{\bf y})$, where $f$ is $\ell$-smooth, strongly-concave in ${\bf y}$ but possibly nonconvex in ${\bf x}$. Most of existing works focus …

Improving Stochastic Cubic Newton with Momentum

2024-10-25 · El Mahdi Chayti, Nikita Doikov, Martin Jaggi

We study stochastic second-order methods for solving general non-convex optimization problems. We propose using a special version of momentum to stabilize the stochastic gradient and Hessian estimates in Newton's method.…

Second-order methods