Decentralized Deterministic Multi-Agent Reinforcement Learning

2021-02-19 · Antoine Grosnit, Desmond Cai, Laura Wynter

[Zhang, ICML 2018] provided the first decentralized actor-critic algorithm for multi-agent reinforcement learning (MARL) that offers convergence guarantees. In that work, policies are stochastic and are defined on finite action spaces. We extend those results to offer a provably-convergent decentralized actor-critic algorithm for learning deterministic policies on continuous action spaces. Deterministic policies are important in real-world settings. To handle the lack of exploration inherent in deterministic policies, we consider both off-policy and on-policy settings. We provide the expression of a local deterministic policy gradient, decentralized deterministic actor-critic algorithms and convergence guarantees for linearly-approximated value functions. This work will help enable decentralized MARL in high-dimensional action spaces and pave the way for more widespread use of MARL.

📄 PDF Abstract BibTeX arXiv:2102.09745

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Message-Dropout: An Efficient Training Method for Multi-Agent Deep Reinforcement Learning

2019-02-18 · Woojun Kim, Myungsik Cho, Youngchul Sung

In this paper, we propose a new learning technique named message-dropout to improve the performance for multi-agent deep reinforcement learning under two application scenarios: 1) classical multi-agent reinforcement lear…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Distributed Area Coverage with High Altitude Balloons Using Multi-Agent Reinforcement Learning

2025-10-04 · Adam Haroon, Tristan Schuler arxiv

High Altitude Balloons (HABs) can leverage stratospheric wind layers for limited horizontal control, enabling applications in reconnaissance, environmental monitoring, and communications networks. Existing multi-agent HA…

Multi-agent Reinforcement Learning

A further exploration of deep Multi-Agent Reinforcement Learning with Hybrid Action Space

2022-08-30 · Hongzhi Hua, Guixuan Wen, Kaigui Wu

The research of extending deep reinforcement learning (drl) to multi-agent field has solved many complicated problems and made great achievements. However, almost all these studies only focus on discrete or continuous ac…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

DSDF: Coordinated look-ahead strategy in stochastic multi-agent reinforcement learning

2021-09-29 · Satheesh K Perepu, Kaushik Dey

Multi-Agent reinforcement learning has received lot of attention in recent years and have applications in many different areas. Existing methods involving Centralized Training and Decentralized execution, attempts to tra…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

INTERACT: Achieving Low Sample and Communication Complexities in Decentralized Bilevel Learning over Networks

2022-07-27 · Zhuqing Liu, Xin Zhang, Prashant Khanduri, Songtao Lu 외

In recent years, decentralized bilevel optimization problems have received increasing attention in the networking and machine learning communities thanks to their versatility in modeling decentralized learning problems o…

Bilevel Optimization Meta-Learning Multi-agent Reinforcement Learning