Group-Agent Reinforcement Learning with Heterogeneous Agents

2025-01-21 · Kaiyue Wu, Xiao-jun Zeng, Tingting Mu

Group-agent reinforcement learning (GARL) is a newly arising learning scenario, where multiple reinforcement learning agents study together in a group, sharing knowledge in an asynchronous fashion. The goal is to improve the learning performance of each individual agent. Under a more general heterogeneous setting where different agents learn using different algorithms, we advance GARL by designing novel and effective group-learning mechanisms. They guide the agents on whether and how to learn from action choices from the others, and allow the agents to adopt available policy and value function models sent by another agent if they perform better. We have conducted extensive experiments on a total of 43 different Atari 2600 games to demonstrate the superior performance of the proposed method. After the group learning, among the 129 agents examined, 96% are able to achieve a learning speed-up, and 72% are able to learn over 100 times faster. Also, around 41% of those agents have achieved a higher accumulated reward score by learning in less than 5% of the time steps required by a single agent when learning on its own.

📄 PDF Abstract BibTeX arXiv:2501.11818

Code (0)

등록된 구현이 없습니다.

Tasks

Atari Games reinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

ADOPT Please enter a description about the method here

Improving Global Parameter-sharing in Physically Heterogeneous Multi-agent Reinforcement Learning with Unified Action Space

2024-08-14 · Xiaoyang Yu, Youfang Lin, Shuo Wang, Kai Lv 외

In a multi-agent system (MAS), action semantics indicates the different influences of agents' actions toward other entities, and can be used to divide agents into groups in a physically heterogeneous MAS. Previous multi-…

Multi-agent Reinforcement Learning SMAC SMAC+

GHQ: Grouped Hybrid Q Learning for Heterogeneous Cooperative Multi-agent Reinforcement Learning

2023-03-02 · Xiaoyang Yu, Youfang Lin, Xiangsen Wang, Sheng Han 외

Previous deep multi-agent reinforcement learning (MARL) algorithms have achieved impressive results, typically in homogeneous scenarios. However, heterogeneous scenarios are also very common and usually harder to solve. …

Multi-agent Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning (RL)+3

Two-stage training algorithm for AI robot soccer

2021-04-13 · TaeYoung Kim, Luiz Felipe Vecchietti, Kyujin Choi, Sanem Sariel 외

In multi-agent reinforcement learning, the cooperative learning behavior of agents is very important. In the field of heterogeneous multi-agent reinforcement learning, cooperative behavior among different types of agents…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)Vocal Bursts Valence Prediction

Heterogeneous RBCs via Deep Multi-Agent Reinforcement Learning

2025-10-14 · Federico Gabriele, Aldo Glielmo, Marco Taboga arxiv

Current macroeconomic models with agent heterogeneity can be broadly divided into two main groups. Heterogeneous-agent general equilibrium (GE) models, such as those based on Heterogeneous Agent New Keynesian (HANK) or K…

Multi-agent Reinforcement Learning

Deep Reinforcement Learning for Optimal Investment and Saving Strategy Selection in Heterogeneous Profiles: Intelligent Agents working towards retirement

2022-06-12 · Fatih Ozhamaratli, Paolo Barucca

The transition from defined benefit to defined contribution pension plans shifts the responsibility for saving toward retirement from governments and institutions to the individuals. Determining optimal saving and invest…

Deep Reinforcement Learning Reinforcement Learning (RL)