Multi-Agent Reinforcement Learning for Problems with Combined Individual and Team Reward

2020-03-24 · Hassam Ullah Sheikh, Ladislau Bölöni

Many cooperative multi-agent problems require agents to learn individual tasks while contributing to the collective success of the group. This is a challenging task for current state-of-the-art multi-agent reinforcement algorithms that are designed to either maximize the global reward of the team or the individual local rewards. The problem is exacerbated when either of the rewards is sparse leading to unstable learning. To address this problem, we present Decomposed Multi-Agent Deep Deterministic Policy Gradient (DE-MADDPG): a novel cooperative multi-agent reinforcement learning framework that simultaneously learns to maximize the global and local rewards. We evaluate our solution on the challenging defensive escort team problem and show that our solution achieves a significantly better and more stable performance than the direct adaptation of the MADDPG algorithm.

📄 PDF Abstract BibTeX arXiv:2003.10598

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Weight Decay 설명 없음

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Adam 설명 없음

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Batch Normalization 설명 없음

MADDPG MADDPG, or Multi-agent DDPG, extends DDPG into a multi-agent policy gradient algorithm where decentralized agents learn a…

Value-Decomposition Networks For Cooperative Multi-Agent Learning

2017-06-16 · Peter Sunehag, Guy Lever, Audrunas Gruslys, Wojciech Marian Czarnecki 외

We study the problem of cooperative multi-agent reinforcement learning with a single joint reward signal. This class of learning problems is difficult because of the often large combined action and observation spaces. In…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Hierarchical Multi-Agent Skill Discovery

2023-09-21 · NeurIPS 2023 11

Skill discovery has shown significant progress in unsupervised reinforcement learning. This approach enables the discovery of a wide range of skills without any extrinsic reward, which can be effectively combined to tack…

Distributed Reinforcement Learning via Gossip

2013-10-28 · Adwaitvedant S. Mathkar, Vivek S. Borkar

We consider the classical TD(0) algorithm implemented on a network of agents wherein the agents also incorporate the updates received from neighboring agents using a gossip-like mechanism. The combined scheme is shown to…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Scalable Centralized Deep Multi-Agent Reinforcement Learning via Policy Gradients

2018-05-22 · Arbaaz Khan, Clark Zhang, Daniel D. Lee, Vijay Kumar 외

In this paper, we explore using deep reinforcement learning for problems with multiple agents. Most existing methods for deep multi-agent reinforcement learning consider only a small number of agents. When the number of …

Deep Reinforcement Learning Distributed Optimization Multi-agent Reinforcement Learning reinforcement-learning+2

Episodic Multi-agent Reinforcement Learning with Curiosity-Driven Exploration

2021-11-22 · NeurIPS 2021 12 · Lulu Zheng, Jiarui Chen, Jianhao Wang, Jiamin He 외

Efficient exploration in deep cooperative multi-agent reinforcement learning (MARL) still remains challenging in complex coordination problems. In this paper, we introduce a novel Episodic Multi-agent reinforcement learn…

Efficient Exploration Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+3