Group-Agent Reinforcement Learning

2022-02-10 · Kaiyue Wu, Xiao-jun Zeng

It can largely benefit the reinforcement learning (RL) process of each agent if multiple geographically distributed agents perform their separate RL tasks cooperatively. Different from multi-agent reinforcement learning (MARL) where multiple agents are in a common environment and should learn to cooperate or compete with each other, in this case each agent has its separate environment and only communicates with others to share knowledge without any cooperative or competitive behaviour as a learning outcome. In fact, this scenario exists widely in real life whose concept can be utilised in many applications, but is not well understood yet and not well formulated. As the first effort, we propose group-agent system for RL as a formulation of this scenario and the third type of RL system with respect to single-agent and multi-agent systems. We then propose a distributed RL framework called DDAL (Decentralised Distributed Asynchronous Learning) designed for group-agent reinforcement learning (GARL). We show through experiments that DDAL achieved desirable performance with very stable training and has good scalability.

📄 PDF Abstract BibTeX arXiv:2202.05135

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Group-Agent Reinforcement Learning with Heterogeneous Agents

2025-01-21 · Kaiyue Wu, Xiao-jun Zeng, Tingting Mu

Group-agent reinforcement learning (GARL) is a newly arising learning scenario, where multiple reinforcement learning agents study together in a group, sharing knowledge in an asynchronous fashion. The goal is to improve…

Atari Games reinforcement-learning Reinforcement Learning

HARP: Human-Assisted Regrouping with Permutation Invariant Critic for Multi-Agent Reinforcement Learning

2024-09-18 · Huawen Hu, Enze Shi, Chenxi Yue, Shuocun Yang 외

Human-in-the-loop reinforcement learning integrates human expertise to accelerate agent learning and provide critical guidance and feedback in complex fields. However, many existing approaches focus on single-agent tasks…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Hierarchical Reinforcement Learning for Optimal Agent Grouping in Cooperative Systems

2025-01-11 · Liyuan Hu

This paper presents a hierarchical reinforcement learning (RL) approach to address the agent grouping or pairing problem in cooperative multi-agent systems. The goal is to simultaneously learn the optimal grouping and ag…

Decision Making Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Automatic Grouping for Efficient Cooperative Multi-Agent Reinforcement Learning

2023-09-21 · NeurIPS 2023 11

Grouping is ubiquitous in natural systems and is essential for promoting efficiency in team coordination. This paper proposes a novel formulation of Group-oriented Multi-Agent Reinforcement Learning (GoMARL), which learn…

Group-Aware Coordination Graph for Multi-Agent Reinforcement Learning

2024-04-17 · Wei Duan, Jie Lu, Junyu Xuan

Cooperative Multi-Agent Reinforcement Learning (MARL) necessitates seamless collaboration among agents, often represented by an underlying relation graph. Existing methods for learning this graph primarily focus on agent…

Decision Making Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+2