GHQ: Grouped Hybrid Q Learning for Heterogeneous Cooperative Multi-agent Reinforcement Learning

2023-03-02 · Xiaoyang Yu, Youfang Lin, Xiangsen Wang, Sheng Han, Kai Lv

Previous deep multi-agent reinforcement learning (MARL) algorithms have achieved impressive results, typically in homogeneous scenarios. However, heterogeneous scenarios are also very common and usually harder to solve. In this paper, we mainly discuss cooperative heterogeneous MARL problems in Starcraft Multi-Agent Challenges (SMAC) environment. We firstly define and describe the heterogeneous problems in SMAC. In order to comprehensively reveal and study the problem, we make new maps added to the original SMAC maps. We find that baseline algorithms fail to perform well in those heterogeneous maps. To address this issue, we propose the Grouped Individual-Global-Max Consistency (GIGM) and a novel MARL algorithm, Grouped Hybrid Q Learning (GHQ). GHQ separates agents into several groups and keeps individual parameters for each group, along with a novel hybrid structure for factorization. To enhance coordination between groups, we maximize the Inter-group Mutual Information (IGMI) between groups' trajectories. Experiments on original and new heterogeneous maps show the fabulous performance of GHQ compared to other state-of-the-art algorithms.

📄 PDF Abstract BibTeX arXiv:2303.01070

Code (1)

Lamperougeyxy/GHQ 공식 구현 pytorch

Tasks

Multi-agent Reinforcement LearningQ-Learningreinforcement-learning Reinforcement Learning (RL)SMAC SMAC+Starcraft

Methods 이 논문이 사용한 방법론

fail 설명 없음

SIGMA: Structured Noise-Effect-Aware Grouped Multi-Agent Aggregation

2026-08-27 · Li Mingqian arxiv

Cooperative multi-agent reinforcement learning (MARL) faces significant challenges in maintaining robust coordination under noisy observations. Although observation disturbances are often introduced independently across …

Multi-agent Reinforcement Learning Starcraft II

Heterogeneous Multi-Agent Reinforcement Learning with Attention for Cooperative and Scalable Feature Transformation

2025-11-26 · Tao Zhe, Huazhen Fang, Kunpeng Liu, Qian Lou 외 arxiv

Feature transformation enhances downstream task performance by generating informative features through mathematical feature crossing. Despite the advancements in deep learning, feature transformation remains essential fo…

Multi-agent Reinforcement Learning

Two-stage training algorithm for AI robot soccer

2021-04-13 · TaeYoung Kim, Luiz Felipe Vecchietti, Kyujin Choi, Sanem Sariel 외

In multi-agent reinforcement learning, the cooperative learning behavior of agents is very important. In the field of heterogeneous multi-agent reinforcement learning, cooperative behavior among different types of agents…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)Vocal Bursts Valence Prediction

CH-MARL: A Multimodal Benchmark for Cooperative, Heterogeneous Multi-Agent Reinforcement Learning

2022-08-26 · Vasu Sharma, Prasoon Goyal, Kaixiang Lin, Govind Thattai 외

We propose a multimodal (vision-and-language) benchmark for cooperative and heterogeneous multi-agent learning. We introduce a benchmark multimodal dataset with tasks involving collaboration between multiple simulated he…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

MASH: Cooperative-Heterogeneous Multi-Agent Reinforcement Learning for Single Humanoid Robot Locomotion

2025-08-14 · Qi Liu, Xiaopeng Zhang, Mingshan Tan, Shuaikang Ma 외 arxiv

This paper proposes a novel method to enhance locomotion for a single humanoid robot through cooperative-heterogeneous multi-agent deep reinforcement learning (MARL). While most existing methods typically employ single-a…