paper-with-me

Papers

Follow-the-Regularized-Leader Routes to Chaos in Routing Games

2021-02-16 · Jakub Bielawski, Thiparat Chotibut, Fryderyk Falniowski, Grzegorz Kosiorowski, Michał Misiurewicz, Georgios Piliouras

We study the emergence of chaotic behavior of Follow-the-Regularized Leader (FoReL) dynamics in games. We focus on the effects of increasing the population size or the scale of costs in congestion games, and generalize recent results on unstable, chaotic behaviors in the Multiplicative Weights Update dynamics to a much larger class of FoReL dynamics. We establish that, even in simple linear non-atomic congestion games with two parallel links and any fixed learning rate, unless the game is fully symmetric, increasing the population size or the scale of costs causes learning dynamics to become unstable and eventually chaotic, in the sense of Li-Yorke and positive topological entropy. Furthermore, we show the existence of novel non-standard phenomena such as the coexistence of stable Nash equilibria and chaos in the same game. We also observe the simultaneous creation of a chaotic attractor as another chaotic attractor gets destroyed. Lastly, although FoReL dynamics can be strange and non-equilibrating, we prove that the time average still converges to an exact equilibrium for any choice of learning rate and any scale of costs.

📄 PDF Abstract BibTeX arXiv:2102.07974

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Chaos of Learning Beyond Zero-sum and Coordination via Game Decompositions

2021-01-01 · ICLR 2021 1 · Yun Kuen Cheung, Yixin Tao

It is of primary interest for AI/ML to understand how agents learn and interact dynamically in competitive environments and games (e.g. GANs). But over the past few decades, this has been shown to be a difficult task, as…

Deployment of Leader-Follower Automated Vehicle Systems for Smart Work Zone Applications with a Queuing-based Traffic Assignment Approach

2023-07-23 · Qing Tang, Xianbiao Hu

The emerging technology of the Autonomous Truck Mounted Attenuator (ATMA), a leader-follower style vehicle system, utilizes connected and automated vehicle capabilities to enhance safety during transportation infrastruct…

Equilibrium traffic assignment

Online Linear Optimization via Smoothing

2014-05-23 · Jacob Abernethy, Chansoo Lee, Abhinav Sinha, Ambuj Tewari

We present a new optimization-theoretic approach to analyzing Follow-the-Leader style algorithms, particularly in the setting where perturbations are used as a tool for regularization. We show that adding a strongly conv…

Learning from Drivers to Tackle the Amazon Last Mile Routing Research Challenge

2022-05-09 · Chen Wu, Yin Song, Verdi March, Eden Duthie

The goal of the Amazon Last Mile Routing Research Challenge is to integrate the real-life experience of Amazon drivers into the solution of optimal route planning and optimization. This paper presents our method that tac…

From Chaos to Order: Symmetry and Conservation Laws in Game Dynamics

2020-01-01 · ICML 2020 1 · Sai Ganesh Nagarajan, David Balduzzi, Georgios Piliouras

Games are an increasingly useful tool for training and testing learning algorithms. Recent examples include GANs, AlphaZero and the AlphaStar league. However, multi-agent learning can be extremely difficult to predict an…