MARL-LNS: Cooperative Multi-agent Reinforcement Learning via Large Neighborhoods Search

2024-04-03 · Weizhe Chen, Sven Koenig, Bistra Dilkina

Cooperative multi-agent reinforcement learning (MARL) has been an increasingly important research topic in the last half-decade because of its great potential for real-world applications. Because of the curse of dimensionality, the popular "centralized training decentralized execution" framework requires a long time in training, yet still cannot converge efficiently. In this paper, we propose a general training framework, MARL-LNS, to algorithmically address these issues by training on alternating subsets of agents using existing deep MARL algorithms as low-level trainers, while not involving any additional parameters to be trained. Based on this framework, we provide three algorithm variants based on the framework: random large neighborhood search (RLNS), batch large neighborhood search (BLNS), and adaptive large neighborhood search (ALNS), which alternate the subsets of agents differently. We test our algorithms on both the StarCraft Multi-Agent Challenge and Google Research Football, showing that our algorithms can automatically reduce at least 10% of training time while reaching the same final skill level as the original algorithm.

📄 PDF Abstract BibTeX arXiv:2404.03101

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement LearningStarcraft

MASH: Cooperative-Heterogeneous Multi-Agent Reinforcement Learning for Single Humanoid Robot Locomotion

2025-08-14 · Qi Liu, Xiaopeng Zhang, Mingshan Tan, Shuaikang Ma 외 arxiv

This paper proposes a novel method to enhance locomotion for a single humanoid robot through cooperative-heterogeneous multi-agent deep reinforcement learning (MARL). While most existing methods typically employ single-a…

Multi-agent Reinforcement Learning

LangMARL: Natural Language Multi-Agent Reinforcement Learning

2026-04-01 · Huaiyuan Yao, Longchao Da, Xiaoou Liu, Charles Fleming 외 arxiv

Large language model (LLM) agents struggle to autonomously evolve coordination strategies in dynamic environments, largely because coarse global outcomes obscure the causal signals needed for local policy refinement. We …

Multi-agent Reinforcement Learning

Promoting Cooperation in Multi-Agent Reinforcement Learning via Mutual Help

2023-02-18 · Yunbo Qiu, Yue Jin, Lebin Yu, Jian Wang 외

Multi-agent reinforcement learning (MARL) has achieved great progress in cooperative tasks in recent years. However, in the local reward scheme, where only local rewards for each agent are given without global rewards sh…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Arena: a toolkit for Multi-Agent Reinforcement Learning

2019-07-20 · Qing Wang, Jiechao Xiong, Lei Han, Meng Fang 외

We introduce Arena, a toolkit for multi-agent reinforcement learning (MARL) research. In MARL, it usually requires customizing observations, rewards and actions for each agent, changing cooperative-competitive agent-inte…

Multi-agent Reinforcement Learning OpenAI Gym reinforcement-learning Reinforcement Learning+3

Evaluating Robustness of Cooperative MARL

2021-09-29 · Nhan Pham, Lam M. Nguyen, Jie Chen, Thanh Lam Hoang 외

In recent years, a proliferation of methods were developed for multi-agent reinforcement learning (MARL). In this paper, we focus on evaluating the robustness of MARL agents in continuous control tasks. In particular, we…

continuous-control Continuous Control MuJoCo Multi-agent Reinforcement Learning+2