Learning to Share in Multi-Agent Reinforcement Learning

2021-12-16 · Yuxuan Yi, Ge Li, YaoWei Wang, Zongqing Lu

In this paper, we study the problem of networked multi-agent reinforcement learning (MARL), where a number of agents are deployed as a partially connected network and each interacts only with nearby agents. Networked MARL requires all agents to make decisions in a decentralized manner to optimize a global objective with restricted communication between neighbors over the network. Inspired by the fact that sharing plays a key role in human's learning of cooperation, we propose LToS, a hierarchically decentralized MARL framework that enables agents to learn to dynamically share reward with neighbors so as to encourage agents to cooperate on the global objective through collectives. For each agent, the high-level policy learns how to share reward with neighbors to decompose the global objective, while the low-level policy learns to optimize the local objective induced by the high-level policies in the neighborhood. The two policies form a bi-level optimization and learn alternately. We empirically demonstrate that LToS outperforms existing methods in both social dilemma and networked MARL scenarios across scales.

📄 PDF Abstract BibTeX arXiv:2112.08702

Code (2)

pku-ai-edge/roadnetsz 공식 구현

zhuliwen/pku_traffic_lights 공식 구현

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Celebrating Diversity in Shared Multi-Agent Reinforcement Learning

2021-06-04 · NeurIPS 2021 12 · Chenghao Li, Tonghan Wang, Chengjie WU, Qianchuan Zhao 외

Recently, deep multi-agent reinforcement learning (MARL) has shown the promise to solve complex cooperative tasks. Its success is partly because of parameter sharing among agents. However, such sharing may lead agents to…

Diversity Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+3

Prism: Spectral Parameter Sharing for Multi-Agent Reinforcement Learning

2026-02-06 · Kyungbeom Kim, Seungwon Oh, Kyung-Joong Kim arxiv

Parameter sharing is a key strategy in multi-agent reinforcement learning (MARL) for improving scalability, yet conventional fully shared architectures often collapse into homogeneous behaviors. Recent methods introduce …

Multi-agent Reinforcement Learning

Actor-Attention-Critic for Multi-Agent Reinforcement Learning

2018-10-05 · ICLR 2019 5 · Shariq Iqbal, Fei Sha

Reinforcement learning in multi-agent scenarios is important for real-world applications but presents challenges beyond those seen in single-agent settings. We present an actor-critic algorithm that trains decentralized …

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Shared Experience Actor-Critic for Multi-Agent Reinforcement Learning

2020-06-12 · NeurIPS 2020 12 · Filippos Christianos, Lukas Schäfer, Stefano V. Albrecht

Exploration in multi-agent reinforcement learning is a challenging problem, especially in environments with sparse rewards. We propose a general method for efficient exploration by sharing experience amongst agents. Our …

Efficient Exploration Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Multi-Agent Reinforcement Learning with Shared Resource in Inventory Management

2021-09-29 · Mingxiao Feng, Guozi Liu, Li Zhao, Lei Song 외

We consider inventory management (IM) problem for a single store with a large number of SKUs (stock keeping units) in this paper, where we need to make replenishment decisions for each SKU to balance its supply and deman…

Management Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1