Deep Multiagent Reinforcement Learning: Challenges and Directions

2021-06-29 · Annie Wong, Thomas Bäck, Anna V. Kononova, Aske Plaat

This paper surveys the field of deep multiagent reinforcement learning. The combination of deep neural networks with reinforcement learning has gained increased traction in recent years and is slowly shifting the focus from single-agent to multiagent environments. Dealing with multiple agents is inherently more complex as (a) the future rewards depend on multiple players' joint actions and (b) the computational complexity increases. We present the most common multiagent problem representations and their main challenges, and identify five research areas that address one or more of these challenges: centralised training and decentralised execution, opponent modelling, communication, efficient coordination, and reward shaping. We find that many computational studies rely on unrealistic assumptions or are not generalisable to other settings; they struggle to overcome the curse of dimensionality or nonstationarity. Approaches from psychology and sociology capture promising relevant behaviours, such as communication and coordination, to help agents achieve better performance in multiagent settings. We suggest that, for multiagent reinforcement learning to be successful, future research should address these challenges with an interdisciplinary approach to open up new possibilities in multiagent reinforcement learning.

📄 PDF Abstract BibTeX arXiv:2106.15691

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Sociology

A Survey and Critique of Multiagent Deep Reinforcement Learning

2018-10-12 · Pablo Hernandez-Leal, Bilal Kartal, Matthew E. Taylor

Deep reinforcement learning (RL) has achieved outstanding results in recent years. This has led to a dramatic increase in the number of applications and methods. Recent works have explored learning beyond single-agent sc…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Combining Planning and Reinforcement Learning for Solving Relational Multiagent Domains

2025-02-26 · Nikhilesh Prabhakar, Ranveer Singh, Harsha Kokel, Sriraam Natarajan 외

Multiagent Reinforcement Learning (MARL) poses significant challenges due to the exponential growth of state and action spaces and the non-stationary nature of multiagent environments. This results in notable sample inef…

reinforcement-learning Reinforcement Learning

Learning Heterogeneous Agent Cooperation via Multiagent League Training

2022-11-13 · Qingxu Fu, Xiaolin Ai, Jianqiang Yi, Tenghai Qiu 외

Many multiagent systems in the real world include multiple types of agents with different abilities and functionality. Such heterogeneous multiagent systems have significant practical advantages. However, they also come …

Diversity reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Prioritized League Reinforcement Learning for Large-Scale Heterogeneous Multiagent Systems

2024-03-26 · Qingxu Fu, Zhiqiang Pu, Min Chen, Tenghai Qiu 외

Large-scale heterogeneous multiagent systems feature various realistic factors in the real world, such as agents with diverse abilities and overall system cost. In comparison to homogeneous systems, heterogeneous systems…

reinforcement-learning Reinforcement Learning

Learning to Teach in Cooperative Multiagent Reinforcement Learning

2018-05-20 · Shayegan Omidshafiei, Dong-Ki Kim, Miao Liu, Gerald Tesauro 외

Collective human knowledge has clearly benefited from the fact that innovations by individuals are taught to others through communication. Similar to human social groups, agents in distributed learning systems would like…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)