paper-with-me

홈 › Papers

No-Regret Learning in Games is Turing Complete

2022-02-24 · Gabriel P. Andrade, Rafael Frongillo, Georgios Piliouras

Games are natural models for multi-agent machine learning settings, such as generative adversarial networks (GANs). The desirable outcomes from algorithmic interactions in these games are encoded as game theoretic equilibrium concepts, e.g. Nash and coarse correlated equilibria. As directly computing an equilibrium is typically impractical, one often aims to design learning algorithms that iteratively converge to equilibria. A growing body of negative results casts doubt on this goal, from non-convergence to chaotic and even arbitrary behaviour. In this paper we add a strong negative result to this list: learning in games is Turing complete. Specifically, we prove Turing completeness of the replicator dynamic on matrix games, one of the simplest possible settings. Our results imply the undecicability of reachability problems for learning algorithms in games, a special case of which is determining equilibrium convergence.

📄 PDF Abstract BibTeX arXiv:2202.11871

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

No-Regret Learning in Bayesian Games

2015-07-02 · NeurIPS 2015 12 · Jason Hartline, Vasilis Syrgkanis, Eva Tardos

Recent price-of-anarchy analyses of games of complete information suggest that coarse correlated equilibria, which characterize outcomes resulting from no-regret learning dynamics, have near-optimal welfare. This work pr…

Approximating Nash Equilibria in General-Sum Games via Meta-Learning

2025-04-26 · David Sychrovský, Christopher Solinas, Revan MacQueen, Kevin Wang 외

Nash equilibrium is perhaps the best-known solution concept in game theory. Such a solution assigns a strategy to each player which offers no incentive to unilaterally deviate. While a Nash equilibrium is guaranteed to a…

Meta-Learning

No-Regret Learning of Nash Equilibrium for Black-Box Games via Gaussian Processes

2024-05-14 · Minbiao Han, Fengxue Zhang, Yuxin Chen

This paper investigates the challenge of learning in black-box games, where the underlying utility function is unknown to any of the agents. While there is an extensive body of literature on the theoretical analysis of a…

Gaussian Processes

Turing Completeness and Sid Meier's Civilization

2021-04-29 · Adrian de Wynter

We prove that three strategy video games from the Sid Meier's Civilization series: Sid Meier's Civilization: Beyond Earth, Sid Meier's Civilization V, and Sid Meier's Civilization VI, are Turing complete. We achieve this…

Alternative Function Approximation Parameterizations for Solving Games: An Analysis of $f$-Regression Counterfactual Regret Minimization

2019-12-06 · Ryan D'Orazio, Dustin Morrill, James R. Wright, Michael Bowling

Function approximation is a powerful approach for structuring large decision problems that has facilitated great achievements in the areas of reinforcement learning and game playing. Regression counterfactual regret mini…

counterfactualregressionreinforcement-learningReinforcement Learning+1