paper-with-me

홈 › Papers

Fast Convergence of Regularized Learning in Games

2015-07-02 · NeurIPS 2015 12 · Vasilis Syrgkanis, Alekh Agarwal, Haipeng Luo, Robert E. Schapire

We show that natural classes of regularized learning algorithms with a form of recency bias achieve faster convergence rates to approximate efficiency and to coarse correlated equilibria in multiplayer normal form games. When each player in a game uses an algorithm from our class, their individual regret decays at $O(T^{-3/4})$, while the sum of utilities converges to an approximate optimum at $O(T^{-1})$--an improvement upon the worst case $O(T^{-1/2})$ rates. We show a black-box reduction for any algorithm in the class to achieve $\tilde{O}(T^{-1/2})$ rates against an adversary, while maintaining the faster rates against algorithms in the class. Our results extend those of [Rakhlin and Shridharan 2013] and [Daskalakis et al. 2014], who only analyzed two-player zero-sum games for specific algorithms.

📄 PDF Abstract BibTeX arXiv:1507.00407

Code (0)

등록된 구현이 없습니다.

Tasks

Form

Similar Papers 제목 키워드 기반

Efficient Last-iterate Convergence Algorithms in Solving Games

2023-08-22 · Linjian Meng, Youzhi Zhang, Zhenxing Ge, Shangdong Yang 외

To establish last-iterate convergence for Counterfactual Regret Minimization (CFR) algorithms in learning a Nash equilibrium (NE) of extensive-form games (EFGs), recent studies reformulate learning an NE of the original …

counterfactual

Mutation-Driven Follow the Regularized Leader for Last-Iterate Convergence in Zero-Sum Games

2022-06-18 · Kenshi Abe, Mitsuki Sakamoto, Atsushi Iwasaki

In this study, we consider a variant of the Follow the Regularized Leader (FTRL) dynamics in two-player zero-sum games. FTRL is guaranteed to converge to a Nash equilibrium when time-averaging the strategies, while a lot…

Scale-Invariant Fast Convergence in Games

2026-02-12 · Taira Tsuchiya, Haipeng Luo, Shinji Ito arxiv

Scale-invariance in games has recently emerged as a widely valued desirable property. Yet, almost all fast convergence guarantees in learning in games require prior knowledge of the utility scale. To address this, we dev…

Near-Optimal Last-Iterate Convergence for Zero-Sum Games with Bandit Feedback and Opponent Actions

2026-05-10 · Soumita Hait, Ping Li, Haipeng Luo, Mengxiao Zhang arxiv

Last-iterate convergence of learning dynamics in games has attracted significant recent attention. In two-player zero-sum games with bandit feedback, where only the loss of the selected action pair is observed, Fiegel et…

Multi-Armed Bandits

Near Optimal Convergence to Coarse Correlated Equilibrium in General-Sum Markov Games

2025-11-04 · Asrin Efe Yorulmaz, Tamer Başar arxiv

No-regret learning dynamics play a central role in game theory, enabling decentralized convergence to equilibrium for concepts such as Coarse Correlated Equilibrium (CCE) or Correlated Equilibrium (CE). In this work, we …