paper-with-me

Papers

Last-Iterate Guarantees for Learning in Co-coercive Games

2026-04-21 · Siddharth Chandak, Ramanan Tamizholi, Nicholas Bambos arxiv

We establish finite-time last-iterate guarantees for vanilla stochastic gradient descent in co-coercive games under noisy feedback. This is a broad class of games that is more general than strongly monotone games, allows for multiple Nash equilibria, and includes examples such as quadratic games with negative semidefinite interaction matrices and potential games with smooth concave potentials. Prior work in this setting has relied on relative noise models, where the noise vanishes as iterates approach equilibrium, an assumption that is often unrealistic in practice. We work instead under a substantially more general noise model in which the second moment of the noise is allowed to scale affinely with the squared norm of the iterates, an assumption natural in learning with unbounded action spaces. Under this model, we prove a last-iterate bound of order $O(\log(t)/t^{1/3})$, the first such bound for co-coercive games under non-vanishing noise. We additionally establish almost sure convergence of the iterates to the set of Nash equilibria and derive time-average convergence guarantees.

📄 PDF Abstract BibTeX arXiv:2604.19065

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Finite-Time Last-Iterate Convergence for Multi-Agent Learning in Games

2020-02-23 · ICML 2020 1 · Tianyi Lin, Zhengyuan Zhou, Panayotis Mertikopoulos, Michael. I. Jordan

In this paper, we consider multi-agent learning via online gradient descent in a class of games called $\lambda$-cocoercive games, a fairly broad class of games that admits many Nash equilibria and that properly includes…

Last-Iterate Convergence Properties of Regret-Matching Algorithms in Games

2023-11-01 · Yang Cai, Gabriele Farina, Julien Grand-Clément, Christian Kroer 외

We study last-iterate convergence properties of algorithms for solving two-player zero-sum games based on Regret Matching$^+$ (RM$^+$). Despite their widespread use for solving real games, virtually nothing is known abou…

Efficient Last-iterate Convergence Algorithms in Solving Games

2023-08-22 · Linjian Meng, Youzhi Zhang, Zhenxing Ge, Shangdong Yang 외

To establish last-iterate convergence for Counterfactual Regret Minimization (CFR) algorithms in learning a Nash equilibrium (NE) of extensive-form games (EFGs), recent studies reformulate learning an NE of the original …

counterfactual

Tight last-iterate convergence rates for no-regret learning in multi-player games

2020-10-26 · NeurIPS 2020 12 · Noah Golowich, Sarath Pattathil, Constantinos Daskalakis

We study the question of obtaining last-iterate convergence rates for no-regret learning algorithms in multi-player games. We show that the optimistic gradient (OG) algorithm with a constant step-size, which is no-regret…

Fast Last-Iterate Convergence of Learning in Games Requires Forgetful Algorithms

2024-06-15 · Yang Cai, Gabriele Farina, Julien Grand-Clément, Christian Kroer 외

Self-play via online learning is one of the premier ways to solve large-scale two-player zero-sum games, both in theory and practice. Particularly popular algorithms include optimistic multiplicative weights update (OMWU…