Curriculum Learning for Cooperation in Multi-Agent Reinforcement Learning

2023-12-19 · Rupali Bhati, Sai Krishna Gottipati, Clodéric Mars, Matthew E. Taylor

While there has been significant progress in curriculum learning and continuous learning for training agents to generalize across a wide variety of environments in the context of single-agent reinforcement learning, it is unclear if these algorithms would still be valid in a multi-agent setting. In a competitive setting, a learning agent can be trained by making it compete with a curriculum of increasingly skilled opponents. However, a general intelligent agent should also be able to learn to act around other agents and cooperate with them to achieve common goals. When cooperating with other agents, the learning agent must (a) learn how to perform the task (or subtask), and (b) increase the overall team reward. In this paper, we aim to answer the question of what kind of cooperative teammate, and a curriculum of teammates should a learning agent be trained with to achieve these two objectives. Our results on the game Overcooked show that a pre-trained teammate who is less skilled is the best teammate for overall team reward but the worst for the learning of the agent. Moreover, somewhat surprisingly, a curriculum of teammates with decreasing skill levels performs better than other types of curricula.

📄 PDF Abstract BibTeX arXiv:2312.11768

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learningvalid

CM3: Cooperative Multi-goal Multi-stage Multi-agent Reinforcement Learning

2018-09-13 · ICLR 2020 1 · Jiachen Yang, Alireza Nakhaei, David Isele, Kikuo Fujimura 외

A variety of cooperative multi-agent control problems require agents to achieve individual goals while contributing to collective success. This multi-goal multi-agent setting poses difficulties for recent algorithms, whi…

Autonomous Vehicles Efficient Exploration Multi-agent Reinforcement Learning reinforcement-learning+2

Towards Skilled Population Curriculum for Multi-Agent Reinforcement Learning

2023-02-07 · Rundong Wang, Longtao Zheng, Wei Qiu, Bowei He 외

Recent advances in multi-agent reinforcement learning (MARL) allow agents to coordinate their behaviors in complex environments. However, common MARL algorithms still suffer from scalability and sparse reward issues. One…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Emergent collective intelligence from massive-agent cooperation and competition

2023-01-04 · HanMo Chen, Stone Tao, Jiaxin Chen, Weihan Shen 외

Inspired by organisms evolving through cooperation and competition between different populations on Earth, we study the emergence of artificial collective intelligence through massive-agent reinforcement learning. To thi…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Communication Enables Cooperation in LLM Agents: A Comparison with Curriculum-Based Approaches

2025-10-07 · Hachem Madmoun, Salem Lahlou arxiv

Eliciting cooperation in multi-agent LLM systems is critical for AI alignment. We investigate two approaches: direct communication and curriculum learning. In a 4-player Stag Hunt, a one-word "cheap talk" channel increas…

It Takes Four to Tango: Multiagent Selfplay for Automatic Curriculum Generation

2022-02-22 · Yuqing Du, Pieter Abbeel, Aditya Grover

We are interested in training general-purpose reinforcement learning agents that can solve a wide variety of goals. Training such agents efficiently requires automatic generation of a goal curriculum. This is challenging…