Multi-Task Multi-Agent Reinforcement Learning via Skill Graphs

2025-07-09 · Guobin Zhu, Rui Zhou, Wenkang Ji, Hongyin Zhang, Donglin Wang, Shiyu Zhao arxiv

Multi-task multi-agent reinforcement learning (MT-MARL) has recently gained attention for its potential to enhance MARL's adaptability across multiple tasks. However, it is challenging for existing multi-task learning methods to handle complex problems, as they are unable to handle unrelated tasks and possess limited knowledge transfer capabilities. In this paper, we propose a hierarchical approach that efficiently addresses these challenges. The high-level module utilizes a skill graph, while the low-level module employs a standard MARL algorithm. Our approach offers two contributions. First, we consider the MT-MARL problem in the context of unrelated tasks, expanding the scope of MTRL. Second, the skill graph is used as the upper layer of the standard hierarchical approach, with training independent of the lower layer, effectively handling unrelated tasks and enhancing knowledge transfer capabilities. Extensive experiments are conducted to validate these advantages and demonstrate that the proposed method outperforms the latest hierarchical MAPPO algorithms. Videos and code are available at https://github.com/WindyLab/MT-MARL-SG

📄 PDF Abstract BibTeX arXiv:2507.06690

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning Multi-Task Learning

Hierarchical Multi-Agent Skill Discovery

2023-09-21 · NeurIPS 2023 11

Skill discovery has shown significant progress in unsupervised reinforcement learning. This approach enables the discovery of a wide range of skills without any extrinsic reward, which can be effectively combined to tack…

Hierarchical and Interpretable Skill Acquisition in Multi-task Reinforcement Learning

2017-12-20 · ICLR 2018 1 · Tianmin Shu, Caiming Xiong, Richard Socher

Learning policies for complex tasks that require multiple different skills is a major challenge in reinforcement learning (RL). It is also a requirement for its deployment in real-world scenarios. This paper proposes a n…

Minecraft reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

SkillGraph: Skill-Augmented Reinforcement Learning for Agents via Evolving Skill Graphs

2026-05-12 · Xiaoyuan Li, Moxin Li, Keqin Bao, Yubo Ma 외 arxiv

Skill libraries enable large language model agents to reuse experience from past interactions, but most existing libraries store skills as isolated entries and retrieve them only by semantic similarity. This leads to two…

Reinforcement Learning Semantic Similarity Decision Making

Skill Discovery of Coordination in Multi-agent Reinforcement Learning

2020-06-07 · Shuncheng He, Jianzhun Shao, Xiangyang Ji

Unsupervised skill discovery drives intelligent agents to explore the unknown environment without task-specific reward signal, and the agents acquire various skills which may be useful when the agents adapt to new tasks.…

Diversity Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolution

2026-09-04 · Jinyuan Feng, Dongmin Li, Yiqun Chen, Yang Gao 외 arxiv

Skill libraries improve the sample efficiency of agentic reinforcement learning (RL) by enabling large language model (LLM) agents to reuse procedural knowledge. Yet existing paradigms exhibit structural shortcomings: th…

Reinforcement Learning