paper-with-me

홈 › Papers

Primal Methods for Variational Inequality Problems with Functional Constraints

2024-03-19 · Liang Zhang, Niao He, Michael Muehlebach

Variational inequality problems are recognized for their broad applications across various fields including machine learning and operations research. First-order methods have emerged as the standard approach for solving these problems due to their simplicity and scalability. However, they typically rely on projection or linear minimization oracles to navigate the feasible set, which becomes computationally expensive in practical scenarios featuring multiple functional constraints. Existing efforts to tackle such functional constrained variational inequality problems have centered on primal-dual algorithms grounded in the Lagrangian function. These algorithms along with their theoretical analysis often require the existence and prior knowledge of the optimal Lagrange multipliers. In this work, we propose a simple primal method, termed Constrained Gradient Method (CGM), for addressing functional constrained variational inequality problems, without requiring any information on the optimal Lagrange multipliers. We establish a non-asymptotic convergence analysis of the algorithm for Minty variational inequality problems with monotone operators under smooth constraints. Remarkably, our algorithms match the complexity of projection-based methods in terms of operator queries for both monotone and strongly monotone settings, while using significantly cheaper oracles based on quadratic programming. Furthermore, we provide several numerical examples to evaluate the efficacy of our algorithms.

📄 PDF Abstract BibTeX arXiv:2403.12859

Code (0)

등록된 구현이 없습니다.

Tasks

Navigate

Similar Papers 제목 키워드 기반

An Augmented Lagrangian Approach to Conically Constrained Non-monotone Variational Inequality Problems

2023-06-02 · Lei Zhao, Daoli Zhu, Shuzhong Zhang

In this paper we consider a non-monotone (mixed) variational inequality model with (nonlinear) convex conic constraints. Through developing an equivalent Lagrangian function-like primal-dual saddle-point system for the V…

Mirror Descent-Type Algorithms for the Variational Inequality Problem with Functional Constraints

2026-02-24 · Mohammad S. Alkousa, Fedor S. Stonyakin, Belal A. Alashqar, Seydamet S. Ablaev arxiv

Variational inequalities play a key role in machine learning research, such as generative adversarial networks, reinforcement learning, adversarial training, and generative models. This paper is devoted to the constraine…

Reinforcement Learning

A Single-Loop Gradient Descent and Perturbed Ascent Algorithm for Nonconvex Functional Constrained Optimization

2022-07-12 · Songtao Lu

Nonconvex constrained optimization problems can be used to model a number of machine learning problems, such as multi-class Neyman-Pearson classification and constrained Markov decision processes. However, such kinds of …

First-order methods for Stochastic Variational Inequality problems with Function Constraints

2023-04-10 · Digvijay Boob, Qi Deng, Mohammad Khalafi

The monotone Variational Inequality (VI) is a general model with important applications in various engineering and scientific domains. In numerous instances, the VI problems are accompanied by function constraints that c…

Primal-dual extrapolation methods for monotone inclusions under local Lipschitz continuity

2022-06-02 · Zhaosong Lu, Sanyou Mei

In this paper we consider a class of monotone inclusion (MI) problems of finding a zero of the sum of two monotone operators, in which one operator is maximal monotone while the other is {\it locally Lipschitz} continuou…