paper-with-me

홈 › Papers

An Augmented Lagrangian Approach to Conically Constrained Non-monotone Variational Inequality Problems

2023-06-02 · Lei Zhao, Daoli Zhu, Shuzhong Zhang

In this paper we consider a non-monotone (mixed) variational inequality model with (nonlinear) convex conic constraints. Through developing an equivalent Lagrangian function-like primal-dual saddle-point system for the VI model in question, we introduce an augmented Lagrangian primal-dual method, to be called ALAVI in the current paper, for solving a general constrained VI model. Under an assumption, to be called the primal-dual variational coherence condition in the paper, we prove the convergence of ALAVI. Next, we show that many existing generalized monotonicity properties are sufficient -- though by no means necessary -- to imply the above mentioned coherence condition, thus are sufficient to ensure convergence of ALAVI. Under that assumption, we further show that ALAVI has in fact an $o(1/\sqrt{k})$ global rate of convergence where $k$ is the iteration count. By introducing a new gap function, this rate further improves to be $O(1/k)$ if the mapping is monotone. Finally, we show that under a metric subregularity condition, even if the VI model may be non-monotone the local convergence rate of ALAVI improves to be linear. Numerical experiments on some randomly generated highly nonlinear and non-monotone VI problems show practical efficacy of the newly proposed method.

📄 PDF Abstract BibTeX arXiv:2306.01214

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Primal Methods for Variational Inequality Problems with Functional Constraints

2024-03-19 · Liang Zhang, Niao He, Michael Muehlebach

Variational inequality problems are recognized for their broad applications across various fields including machine learning and operations research. First-order methods have emerged as the standard approach for solving …

Navigate

A first-order augmented Lagrangian method for constrained minimax optimization

2023-01-05 · Zhaosong Lu, Sanyou Mei

In this paper we study a class of constrained minimax problems. In particular, we propose a first-order augmented Lagrangian method for solving them, whose subproblems turn out to be a much simpler structured minimax pro…

AL-CoLe: Augmented Lagrangian for Constrained Learning

2025-10-23 · Ignacio Boero, Ignacio Hounie, Alejandro Ribeiro arxiv

Despite the non-convexity of most modern machine learning parameterizations, Lagrangian duality has become a popular tool for addressing constrained learning problems. We revisit Augmented Lagrangian methods, which aim t…

Analysis of the $(μ/μ_I,λ)$-CSA-ES with Repair by Projection Applied to a Conically Constrained Problem

2019-01-23 · Patrick Spettel, Hans-Georg Beyer

Theoretical analyses of evolution strategies are indispensable for gaining a deep understanding of their inner workings. For constrained problems, rather simple problems are of interest in the current research. This work…

Constrained Optimization via Exact Augmented Lagrangian and Randomized Iterative Sketching

2023-05-28 · Ilgee Hong, Sen Na, Michael W. Mahoney, Mladen Kolar

We consider solving equality-constrained nonlinear, nonconvex optimization problems. This class of problems appears widely in a variety of applications in machine learning and engineering, ranging from constrained deep n…