Deep Reinforcement Learning for Multi-Agent Coordination

2025-10-04 · Kehinde O. Aina, Sehoon Ha arxiv

We address the challenge of coordinating multiple robots in narrow and confined environments, where congestion and interference often hinder collective task performance. Drawing inspiration from insect colonies, which achieve robust coordination through stigmergy -- modifying and interpreting environmental traces -- we propose a Stigmergic Multi-Agent Deep Reinforcement Learning (S-MADRL) framework that leverages virtual pheromones to model local and social interactions, enabling decentralized emergent coordination without explicit communication. To overcome the convergence and scalability limitations of existing algorithms such as MADQN, MADDPG, and MAPPO, we leverage curriculum learning, which decomposes complex tasks into progressively harder sub-problems. Simulation results show that our framework achieves the most effective coordination of up to eight agents, where robots self-organize into asymmetric workload distributions that reduce congestion and modulate group performance. This emergent behavior, analogous to strategies observed in nature, demonstrates a scalable solution for decentralized multi-agent coordination in crowded environments with communication constraints.

📄 PDF Abstract BibTeX arXiv:2510.03592

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

CODA: Coordination via On-Policy Diffusion for Multi-Agent Offline Reinforcement Learning

2026-04-25 · Marcel Hedman, Kale-ab Abebe Tessera, Juan Claude Formanek, Anya Sims 외 arxiv

Offline multi-agent reinforcement learning (MARL) enables policy learning from fixed datasets, but is prone to coordination failure: agents trained on static, off-policy data converge to suboptimal joint behaviours becau…

Multi-agent Reinforcement Learning Data Augmentation

Coordination-driven learning in multi-agent problem spaces

2018-09-13 · Sean L. Barton, Nicholas R. Waytowich, Derrik E. Asher

We discuss the role of coordination as a direct learning objective in multi-agent reinforcement learning (MARL) domains. To this end, we present a novel means of quantifying coordination in multi-agent systems, and discu…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Centralised rehearsal of decentralised cooperation: Multi-agent reinforcement learning for the scalable coordination of residential energy flexibility

2023-05-30 · Flora Charbonnier, Bei Peng, Thomas Morstyn, Malcolm McCulloch

This paper investigates how deep multi-agent reinforcement learning can enable the scalable and privacy-preserving coordination of residential energy flexibility. The coordination of distributed resources such as electri…

Multi-agent Reinforcement Learning Privacy Preserving reinforcement-learning Reinforcement Learning

HAVEN: Hierarchical Cooperative Multi-Agent Reinforcement Learning with Dual Coordination Mechanism

2021-10-14 · Zhiwei Xu, Yunpeng Bai, Bin Zhang, Dapeng Li 외

Recently, some challenging tasks in multi-agent systems have been solved by some hierarchical reinforcement learning methods. Inspired by the intra-level and inter-level coordination in the human nervous system, we propo…

Hierarchical Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+3

Deep Meta Coordination Graphs for Multi-agent Reinforcement Learning

2025-02-06 · Nikunj Gupta, James Zachary Hare, Rajgopal Kannan, Viktor Prasanna

This paper presents deep meta coordination graphs (DMCG) for learning cooperative policies in multi-agent reinforcement learning (MARL). Coordination graph formulations encode local interactions and accordingly factorize…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning