paper-with-me

Papers

A Newton-CG based barrier-augmented Lagrangian method for general nonconvex conic optimization

2023-01-10 · Chuan He, Heng Huang, Zhaosong Lu

In this paper we consider finding an approximate second-order stationary point (SOSP) of general nonconvex conic optimization that minimizes a twice differentiable function subject to nonlinear equality constraints and also a convex conic constraint. In particular, we propose a Newton-conjugate gradient (Newton-CG) based barrier-augmented Lagrangian method for finding an approximate SOSP of this problem. Under some mild assumptions, we show that our method enjoys a total inner iteration complexity of $\widetilde{\cal O}(\epsilon^{-11/2})$ and an operation complexity of $\widetilde{\cal O}(\epsilon^{-11/2}\min\{n,\epsilon^{-5/4}\})$ for finding an $(\epsilon,\sqrt{\epsilon})$-SOSP of general nonconvex conic optimization with high probability. Moreover, under a constraint qualification, these complexity bounds are improved to $\widetilde{\cal O}(\epsilon^{-7/2})$ and $\widetilde{\cal O}(\epsilon^{-7/2}\min\{n,\epsilon^{-3/4}\})$, respectively. To the best of our knowledge, this is the first study on the complexity of finding an approximate SOSP of general nonconvex conic optimization. Preliminary numerical results are presented to demonstrate superiority of the proposed method over first-order methods in terms of solution quality.

📄 PDF Abstract BibTeX arXiv:2301.04204

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Newton-CG based augmented Lagrangian method for finding a second-order stationary point of nonconvex equality constrained optimization with complexity guarantees

2023-01-09 · Chuan He, Zhaosong Lu, Ting Kei Pong

In this paper we consider finding a second-order stationary point (SOSP) of nonconvex equality constrained optimization when a nearly feasible point is known. In particular, we first propose a new Newton-CG method for fi…

Constrained Optimization via Exact Augmented Lagrangian and Randomized Iterative Sketching

2023-05-28 · Ilgee Hong, Sen Na, Michael W. Mahoney, Mladen Kolar

We consider solving equality-constrained nonlinear, nonconvex optimization problems. This class of problems appears widely in a variety of applications in machine learning and engineering, ranging from constrained deep n…

A distributed semismooth Newton based augmented Lagrangian method for distributed optimization

2026-02-27 · Qihao Ma, Chengjing Wang, Peipei Tang, Dunbiao Niu 외 arxiv

This paper proposes a novel distributed semismooth Newton based augmented Lagrangian method for solving a class of optimization problems over networks, where the global objective is defined as the sum of locally held cos…

Distributed Optimization

A Newton-CG based barrier method for finding a second-order stationary point of nonconvex conic optimization with complexity guarantees

2022-07-12 · Chuan He, Zhaosong Lu

In this paper we consider finding an approximate second-order stationary point (SOSP) of nonconvex conic optimization that minimizes a twice differentiable function over the intersection of an affine subspace and a conve…

Second-order methods

A proximal augmented Lagrangian method for nonconvex optimization with equality and inequality constraints

2025-09-02 · Adeyemi D. Adeoye, Puya Latafat, Alberto Bemporad arxiv

We propose an inexact proximal augmented Lagrangian method (P-ALM) for nonconvex structured optimization problems. The proposed method features an easily implementable rule not only for updating the penalty parameters, b…