Promoting Cooperation in Multi-Agent Reinforcement Learning via Mutual Help

2023-02-18 · Yunbo Qiu, Yue Jin, Lebin Yu, Jian Wang, Xudong Zhang

Multi-agent reinforcement learning (MARL) has achieved great progress in cooperative tasks in recent years. However, in the local reward scheme, where only local rewards for each agent are given without global rewards shared by all the agents, traditional MARL algorithms lack sufficient consideration of agents' mutual influence. In cooperative tasks, agents' mutual influence is especially important since agents are supposed to coordinate to achieve better performance. In this paper, we propose a novel algorithm Mutual-Help-based MARL (MH-MARL) to instruct agents to help each other in order to promote cooperation. MH-MARL utilizes an expected action module to generate expected other agents' actions for each particular agent. Then, the expected actions are delivered to other agents for selective imitation during training. Experimental results show that MH-MARL improves the performance of MARL both in success rate and cumulative reward.

📄 PDF Abstract BibTeX arXiv:2302.09277

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Situation-Dependent Causal Influence-Based Cooperative Multi-agent Reinforcement Learning

2023-12-15 · Xiao Du, Yutong Ye, Pengyu Zhang, Yaning Yang 외

Learning to collaborate has witnessed significant progress in multi-agent reinforcement learning (MARL). However, promoting coordination among agents and enhancing exploration capabilities remain challenges. In multi-age…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Emergent Cooperation in Quantum Multi-Agent Reinforcement Learning Using Communication

2026-01-26 · Michael Kölle, Christian Reff, Leo Sünkel, Julian Hager 외 arxiv

Emergent cooperation in classical Multi-Agent Reinforcement Learning has gained significant attention, particularly in the context of Sequential Social Dilemmas (SSDs). While classical reinforcement learning approaches h…

Multi-agent Reinforcement Learning

Graph Convolutional Reinforcement Learning

2018-10-22 · ICLR 2020 1 · Jiechuan Jiang, Chen Dun, Tiejun Huang, Zongqing Lu

Learning to cooperate is crucially important in multi-agent environments. The key is to understand the mutual interplay between agents. However, multi-agent environments are highly dynamic, where agents keep moving and t…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Enhancing Cooperation through Selective Interaction and Long-term Experiences in Multi-Agent Reinforcement Learning

2024-05-04 · Tianyu Ren, Xiao-jun Zeng

The significance of network structures in promoting group cooperation within social dilemmas has been widely recognized. Prior studies attribute this facilitation to the assortment of strategies driven by spatial interac…

Attribute Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Deconstructing Cooperation and Ostracism via Multi-Agent Reinforcement Learning

2023-10-06 · Atsushi Ueshima, Shayegan Omidshafiei, Hirokazu Shirado

Cooperation is challenging in biological systems, human societies, and multi-agent systems in general. While a group can benefit when everyone cooperates, it is tempting for each agent to act selfishly instead. Prior hum…