Learning Policy Representations in Multiagent Systems

2018-06-17 · ICML 2018 7 · Aditya Grover, Maruan Al-Shedivat, Jayesh K. Gupta, Yura Burda, Harrison Edwards

Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific prior knowledge. We propose a general learning framework for modeling agent behavior in any multiagent system using only a handful of interaction data. Our framework casts agent modeling as a representation learning problem. Consequently, we construct a novel objective inspired by imitation learning and agent identification and design an algorithm for unsupervised learning of representations of agent policies. We demonstrate empirically the utility of the proposed framework in (i) a challenging high-dimensional competitive environment for continuous control and (ii) a cooperative environment for communication, on supervised predictive tasks, unsupervised clustering, and policy optimization using deep reinforcement learning.

📄 PDF Abstract BibTeX arXiv:1806.06464

Code (0)

등록된 구현이 없습니다.

Tasks

Clusteringcontinuous-control Continuous ControlDeep Reinforcement LearningImitation Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Representation Learning

Coordinating Multiagent Industrial Symbiosis

2020-06-02 · Vahid Yazdanpanah, Devrim Murat Yazan, W. Henk M. Zijm

We present a formal multiagent framework for coordinating a class of collaborative industrial practices called Industrial Symbiotic Networks (ISNs) as cooperative games. The game-theoretic formulation of ISNs enables sys…

Learning Heterogeneous Agent Cooperation via Multiagent League Training

2022-11-13 · Qingxu Fu, Xiaolin Ai, Jianqiang Yi, Tenghai Qiu 외

Many multiagent systems in the real world include multiple types of agents with different abilities and functionality. Such heterogeneous multiagent systems have significant practical advantages. However, they also come …

Diversity reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Policy Resonance Approach to Solve the Problem of Responsibility Diffusion in Multiagent Reinforcement Learning

2022-08-16 · Qingxu Fu, Tenghai Qiu, Jianqiang Yi, Zhiqiang Pu 외

SOTA multiagent reinforcement algorithms distinguish themselves in many ways from their single-agent equivalences. However, most of them still totally inherit the single-agent exploration-exploitation strategy. Naively i…

Prioritized League Reinforcement Learning for Large-Scale Heterogeneous Multiagent Systems

2024-03-26 · Qingxu Fu, Zhiqiang Pu, Min Chen, Tenghai Qiu 외

Large-scale heterogeneous multiagent systems feature various realistic factors in the real world, such as agents with diverse abilities and overall system cost. In comparison to homogeneous systems, heterogeneous systems…

reinforcement-learning Reinforcement Learning

A Policy Gradient Algorithm for Learning to Learn in Multiagent Reinforcement Learning

2020-10-31 · Dong-Ki Kim, Miao Liu, Matthew Riemer, Chuangchuang Sun 외

A fundamental challenge in multiagent reinforcement learning is to learn beneficial behaviors in a shared environment with other simultaneously learning agents. In particular, each agent perceives the environment as effe…

reinforcement-learning Reinforcement Learning (RL)