Mean Field Reinforcement Learning

2026-07-01 · René Carmona, Mathieu Laurière arxiv

This monograph provides an introduction to mean field reinforcement learning through the lens of Markov decision processes arising from large-population stochastic control with mean field interactions and common noise. Starting from the connection between multi-agent reinforcement learning and mean field control, it develops the probabilistic, mathematical, and control-theoretic framework needed to formulate representative-agent learning problems, analyze their relationship with finite-population systems, and study both general and linear-quadratic models. The presentation includes dynamic programming principles, propagation-of-chaos limits, and theoretical analyses of tabular Q-learning and policy-gradient methods. It also discusses numerical implementations, including tabular schemes and deep reinforcement learning methods such as deep deterministic policy gradient. The goal is to give readers a coherent bridge between mean field control theory and reinforcement learning methodology, emphasizing the mathematical structure of the problems and the design of tractable learning approaches for large stochastic populations.

📄 PDF Abstract BibTeX arXiv:2607.01525

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

Provable Fictitious Play for General Mean-Field Games

2020-10-08 · Qiaomin Xie, Zhuoran Yang, Zhaoran Wang, Andreea Minca

We propose a reinforcement learning algorithm for stationary mean-field games, where the goal is to learn a pair of mean-field state and stationary policy that constitutes the Nash equilibrium. When viewing the mean-fiel…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Multi Type Mean Field Reinforcement Learning

2020-02-06 · Sriram Ganapathi Subramanian, Pascal Poupart, Matthew E. Taylor, Nidhi Hegde

Mean field theory provides an effective way of scaling multiagent reinforcement learning algorithms to environments with many agents that can be abstracted by a virtual mean agent. In this paper, we extend mean field mul…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Vocal Bursts Type Prediction

Theoretical understanding of adversarial reinforcement learning via mean-field optimal control

2021-09-29 · ZiMing Wang, Fengxiang He, Tao Cui, DaCheng Tao

Adversarial reinforcement learning has been shown promising in solving games in adversarial environments, while the theoretical understanding is still premature. This paper theoretically analyses the convergence and gene…

Generalization Bounds reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Partially Observable Mean Field Multi-Agent Reinforcement Learning Based on Graph-Attention

2023-04-25 · Min Yang, Guanjun Liu, Ziyuan Zhou

Traditional multi-agent reinforcement learning algorithms are difficultly applied in a large-scale multi-agent environment. The introduction of mean field theory has enhanced the scalability of multi-agent reinforcement …

Graph Attention Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Discrete-Time Mean Field Control with Environment States

2021-04-30 · Kai Cui, Anam Tahir, Mark Sinzger, Heinz Koeppl

Multi-agent reinforcement learning methods have shown remarkable potential in solving complex multi-agent problems but mostly lack theoretical guarantees. Recently, mean field control and mean field games have been estab…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+2