Game Theory and Multi-Agent Reinforcement Learning : From Nash Equilibria to Evolutionary Dynamics

2024-12-29 · Neil De La Fuente, Miquel Noguer i Alonso, Guim Casadellà

This paper explores advanced topics in complex multi-agent systems building upon our previous work. We examine four fundamental challenges in Multi-Agent Reinforcement Learning (MARL): non-stationarity, partial observability, scalability with large agent populations, and decentralized learning. The paper provides mathematical formulations and analysis of recent algorithmic advancements designed to address these challenges, with a particular focus on their integration with game-theoretic concepts. We investigate how Nash equilibria, evolutionary game theory, correlated equilibrium, and adversarial dynamics can be effectively incorporated into MARL algorithms to improve learning outcomes. Through this comprehensive analysis, we demonstrate how the synthesis of game theory and MARL can enhance the robustness and effectiveness of multi-agent systems in complex, dynamic environments.

📄 PDF Abstract BibTeX arXiv:2412.20523

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Reinforcement Learning In Two Player Zero Sum Simultaneous Action Games

2021-10-10 · Patrick Phillips

Two player zero sum simultaneous action games are common in video games, financial markets, war, business competition, and many other settings. We first introduce the fundamental concepts of reinforcement learning in two…

Imitation Learning Meta-Learning reinforcement-learning Reinforcement Learning+2

Exploiting Approximate Symmetry for Efficient Multi-Agent Reinforcement Learning

2024-08-27 · Batuhan Yardim, Niao He

Mean-field games (MFG) have become significant tools for solving large-scale multi-agent reinforcement learning problems under symmetry. However, the assumption of exact symmetry limits the applicability of MFGs, as real…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

On Gradient-Based Learning in Continuous Games

2018-04-16 · Eric Mazumdar, Lillian J. Ratliff, S. Shankar Sastry

We formulate a general framework for competitive gradient-based learning that encompasses a wide breadth of multi-agent learning algorithms, and analyze the limiting behavior of competitive gradient-based learning algori…

Multi-agent Reinforcement Learning Reinforcement Learning

Resolving Implicit Coordination in Multi-Agent Deep Reinforcement Learning with Deep Q-Networks & Game Theory

2020-12-08 · Griffin Adams, Sarguna Janani Padmanabhan, Shivang Shekhar

We address two major challenges of implicit coordination in multi-agent deep reinforcement learning: non-stationarity and exponential growth of state-action space, by combining Deep-Q Networks for policy learning with Na…

Deep Reinforcement Learning OpenAI Gym Reinforcement Learning (RL)

Reinforcement Learning for Finite Space Mean-Field Type Games

2024-09-25 · Kai Shao, Jiacheng Shen, Chijie An, Mathieu Laurière

Mean field type games (MFTGs) describe Nash equilibria between large coalitions: each coalition consists of a continuum of cooperative agents who maximize the average reward of their coalition while interacting non-coope…

Deep Reinforcement Learning Q-Learning Quantization reinforcement-learning+1