paper-with-me

홈 › Papers

Games played by Exponential Weights Algorithms

2024-07-09 · Maurizio d'Andrea, Fabien Gensbittel, Jérôme Renault

This paper studies the last-iterate convergence properties of the exponential weights algorithm with constant learning rates. We consider a repeated interaction in discrete time, where each player uses an exponential weights algorithm characterized by an initial mixed action and a fixed learning rate, so that the mixed action profile $p^t$ played at stage $t$ follows an homogeneous Markov chain. At first, we show that whenever a strict Nash equilibrium exists, the probability to play a strict Nash equilibrium at the next stage converges almost surely to 0 or 1. Secondly, we show that the limit of $p^t$, whenever it exists, belongs to the set of ``Nash Equilibria with Equalizing Payoffs''. Thirdly, we show that in strong coordination games, where the payoff of a player is positive on the diagonal and 0 elsewhere, $p^t$ converges almost surely to one of the strict Nash equilibria. We conclude with open questions.

📄 PDF Abstract BibTeX arXiv:2407.06676

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Fast Routing under Uncertainty: Adaptive Learning in Congestion Games via Exponential Weights

2021-12-01 · NeurIPS 2021 12 · Dong Quan Vu, Kimon Antonakopoulos, Panayotis Mertikopoulos

We examine an adaptive learning framework for nonatomic congestion games where the players' cost functions may be subject to exogenous fluctuations (e.g., due to disturbances in the network, variations in the traffic goi…

A unified stochastic approximation framework for learning in games

2022-06-08 · Panayotis Mertikopoulos, Ya-Ping Hsieh, Volkan Cevher

We develop a flexible stochastic approximation framework for analyzing the long-run behavior of learning in games (both continuous and finite). The proposed analysis template incorporates a wide array of popular learning…

Taming the Exponential Action Set: Sublinear Regret and Fast Convergence to Nash Equilibrium in Online Congestion Games

2023-06-19 · Jing Dong, Jingyu Wu, Siwei Wang, Baoxiang Wang 외

The congestion game is a powerful model that encompasses a range of engineering systems such as traffic networks and resource allocation. It describes the behavior of a group of agents who share a common set of $F$ facil…

Online Isotonic Regression

2016-03-14 · Wojciech Kotłowski, Wouter M. Koolen, Alan Malek

We consider the online version of the isotonic regression problem. Given a set of linearly ordered points (e.g., on the real line), the learner must predict labels sequentially at adversarially chosen positions and is ev…

regression

A Robust Characterization of Nash Equilibrium

2023-07-06 · Florian Brandl, Felix Brandt

We characterize Nash equilibrium by postulating coherent behavior across varying games. Nash equilibrium is the only solution concept that satisfies the following axioms: (i) strictly dominant actions are played with pos…