Reinforcement Learning, Collusion, and the Folk Theorem

2024-11-19 · Galit Askenazi-Golan, Domenico Mergoni Cecchelli, Edward Plumb

We explore the behaviour emerging from learning agents repeatedly interacting strategically for a wide range of learning dynamics that includes projected gradient, replicator and log-barrier dynamics. Going beyond the better-understood classes of potential games and zero-sum games, we consider the setting of a general repeated game with finite recall, for different forms of monitoring. We obtain a Folk Theorem-like result and characterise the set of payoff vectors that can be obtained by these dynamics, discovering a wide range of possibilities for the emergence of algorithmic collusion.

📄 PDF Abstract BibTeX arXiv:2411.12725

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Uniformly Strict Equilibrium for Repeated Games with Private Monitoring and Communication

2023-11-20 · Richard McLean, Ichiro Obara, Andrew Postlewaite

Cooperation through repetition is an important theme in game theory. In this regard, various celebrated ``folk theorems'' have been proposed for repeated games in increasingly more complex environments. There has, howeve…

Proofs for Folklore Theorems on the Radon-Nikodym Derivative

2025-01-30 · Yaiza Bermudez, Gaetan Bisson, Iñaki Esnaola, Samir M. Perlaza

In this paper, rigorous statements and formal proofs are presented for both foundational and advanced folklore theorems on the Radon-Nikodym derivative. The cases of conditional and marginal probability measures are care…

Characterising Simulation-Based Program Equilibria

2024-12-19 · Emery Cooper, Caspar Oesterheld, Vincent Conitzer

In Tennenholtz's program equilibrium, players of a game submit programs to play on their behalf. Each program receives the other programs' source code and outputs an action. This can model interactions involving AI agent…

Hidden in Plain Text: Emergence & Mitigation of Steganographic Collusion in LLMs

2024-10-02 · Yohan Mathew, Ollie Matthews, Robert McCarthy, Joan Velja 외

The rapid proliferation of frontier model agents promises significant societal advances but also raises concerns about systemic risks arising from unsafe interactions. Collusion to the disadvantage of others has been ide…

In-Context Reinforcement Learning reinforcement-learning Reinforcement Learning

Tacit algorithmic collusion in deep reinforcement learning guided price competition: A study using EV charge pricing game

2024-01-25 · Diwas Paudel, Tapas K. Das

Players in pricing games with complex structures are increasingly adopting artificial intelligence (AI) aided learning algorithms to make pricing decisions for maximizing profits. This is raising concern for the antitrus…

Deep Reinforcement Learning