CCL: Collaborative Curriculum Learning for Sparse-Reward Multi-Agent Reinforcement Learning via Co-evolutionary Task Evolution

2025-05-08 · Yufei Lin, Chengwei Ye, Huanzhen Zhang, Kangsheng Wang, Linuo Xu, Shuyan Liu, Zeyu Zhang

Sparse reward environments pose significant challenges in reinforcement learning, especially within multi-agent systems (MAS) where feedback is delayed and shared across agents, leading to suboptimal learning. We propose Collaborative Multi-dimensional Course Learning (CCL), a novel curriculum learning framework that addresses this by (1) refining intermediate tasks for individual agents, (2) using a variational evolutionary algorithm to generate informative subtasks, and (3) co-evolving agents with their environment to enhance training stability. Experiments on five cooperative tasks in the MPE and Hide-and-Seek environments show that CCL outperforms existing methods in sparse reward settings.

📄 PDF Abstract BibTeX arXiv:2505.07854

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

CO-PILOT: COllaborative Planning and reInforcement Learning On sub-Task curriculum

2021-12-01 · NeurIPS 2021 12 · Shuang Ao, Tianyi Zhou, Guodong Long, Qinghua Lu 외

Goal-conditioned reinforcement learning (RL) usually suffers from sparse reward and inefficient exploration in long-horizon tasks. Planning can find the shortest path to a distant goal that provides dense reward/guidance…

continuous-control Continuous Control reinforcement-learning Reinforcement Learning (RL)

Collaborative Target Search with a Visual Drone Swarm: An Adaptive Curriculum Embedded Multistage Reinforcement Learning Approach

2022-04-26 · Jiaping Xiao, Phumrapee Pisutsin, Mir Feroskhan

Equipping drones with target search capabilities is highly desirable for applications in disaster rescue and smart warehouse delivery systems. Multiple intelligent drones that can collaborate with each other and maneuver…

Deep Reinforcement Learning Management

GLIDE-RL: Grounded Language Instruction through DEmonstration in RL

2024-01-03 · Chaitanya Kharyal, Sai Krishna Gottipati, Tanmay Kumar Sinha, Srijita Das 외

One of the final frontiers in the development of complex human - AI collaborative systems is the ability of AI agents to comprehend the natural language and perform tasks accordingly. However, training efficient Reinforc…

Continual Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Towards Skilled Population Curriculum for Multi-Agent Reinforcement Learning

2023-02-07 · Rundong Wang, Longtao Zheng, Wei Qiu, Bowei He 외

Recent advances in multi-agent reinforcement learning (MARL) allow agents to coordinate their behaviors in complex environments. However, common MARL algorithms still suffer from scalability and sparse reward issues. One…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Variational Automatic Curriculum Learning for Sparse-Reward Cooperative Multi-Agent Problems

2021-11-08 · NeurIPS 2021 12 · Jiayu Chen, Yuanxin Zhang, Yuanfan Xu, Huimin Ma 외

We introduce a curriculum learning algorithm, Variational Automatic Curriculum Learning (VACL), for solving challenging goal-conditioned cooperative multi-agent reinforcement learning problems. We motivate our paradigm t…