Rethinking the Implementation Matters in Cooperative Multi-Agent Reinforcement Learning

2021-02-06 · Jian Hu, Siyang Jiang, Seth Austin Harding, Haibin Wu, Shih-wei Liao

Multi-Agent Reinforcement Learning (MARL) has seen revolutionary breakthroughs with its successful application to multi-agent cooperative tasks such as computer games and robot swarms. QMIX, a widely popular MARL algorithm, has been used to solve cooperative tasks, e.g. Starcraft Multi-Agent Challenge (SMAC), Difficulty-Enhanced Predator-Prey (DEPP). Recent variants of QMIX target relaxing the monotonicity constraint of QMIX, allowing for performance improvement in SMAC. However, in this paper, we investigate the code-level optimizations of these variants and the monotonicity constraint. We find that (1) such improvements of the variants are significantly affected by various code-level optimizations; (2) QMIX with normalized optimizations outperforms other previous works in SMAC; (3) the monotonicity constraint may improve sample efficiency in SMAC and DEPP. Last, a discussion with theoretical analysis is demonstrated about why QMIX works well in SMAC. We open-source the code at \url{https://github.com/hijkzzz/pymarl2}.

📄 PDF Abstract BibTeX arXiv:2102.03479

Code (2)

hijkzzz/pymarl2 공식 구현 pytorch

Acciorocketships/pymarl2 pytorch

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)SMAC SMAC+StarcraftStarcraft II

Cooperative Profiles Predict Multi-Agent LLM Team Performance in AI for Science Workflows

2026-04-22 · Shivani Kumar, Adarsh Bharathwaj, David Jurgens arxiv

Multi-agent systems built from teams of large language models (LLMs) are increasingly deployed for collaborative scientific reasoning and problem-solving. These systems require agents to coordinate under shared constrain…

Locality Matters: A Scalable Value Decomposition Approach for Cooperative Multi-Agent Reinforcement Learning

2021-09-22 · Roy Zohar, Shie Mannor, Guy Tennenholtz

Cooperative multi-agent reinforcement learning (MARL) faces significant scalability issues due to state and action spaces that are exponentially large in the number of agents. As environments grow in size, effective cred…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Coordination Matters: Evaluation of Cooperative Multi-Agent Reinforcement Learning

2026-05-07 · Maria Ana Cardei, Matthew Landers, Afsaneh Doryab arxiv

Cooperative multi-agent reinforcement learning (MARL) benchmarks commonly emphasize aggregate outcomes such as return, success rate, or completion time. While essential, these metrics often fail to reveal how agents coor…

Multi-agent Reinforcement Learning

CH-MARL: A Multimodal Benchmark for Cooperative, Heterogeneous Multi-Agent Reinforcement Learning

2022-08-26 · Vasu Sharma, Prasoon Goyal, Kaixiang Lin, Govind Thattai 외

We propose a multimodal (vision-and-language) benchmark for cooperative and heterogeneous multi-agent learning. We introduce a benchmark multimodal dataset with tasks involving collaboration between multiple simulated he…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

How to solve a classification problem using a cooperative tiling Multi-Agent System?

2022-09-15 · Thibault Fourez, Nicolas Verstaevel, Frédéric Migeon, Frédéric Schettini 외

Adaptive Multi-Agent Systems (AMAS) transform dynamic problems into problems of local cooperation between agents. We present smapy, an ensemble based AMAS implementation for mobility prediction, whose agents are provided…

Classification