Effective Multi-Agent Deep Reinforcement Learning Control with Relative Entropy Regularization

2023-09-26 · Chenyang Miao, Yunduan Cui, Huiyun Li, Xinyu Wu

In this paper, a novel Multi-agent Reinforcement Learning (MARL) approach, Multi-Agent Continuous Dynamic Policy Gradient (MACDPP) was proposed to tackle the issues of limited capability and sample efficiency in various scenarios controlled by multiple agents. It alleviates the inconsistency of multiple agents' policy updates by introducing the relative entropy regularization to the Centralized Training with Decentralized Execution (CTDE) framework with the Actor-Critic (AC) structure. Evaluated by multi-agent cooperation and competition tasks and traditional control tasks including OpenAI benchmarks and robot arm manipulation, MACDPP demonstrates significant superiority in learning capability and sample efficiency compared with both related multi-agent and widely implemented signal-agent baselines and therefore expands the potential of MARL in effectively learning challenging control scenarios.

📄 PDF Abstract BibTeX arXiv:2309.14727

Code (1)

AdrienLin1/MACDPP 공식 구현 paddle

Tasks

Deep Reinforcement LearningMulti-agent Reinforcement Learning reinforcement-learning

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음

Relative Distributed Formation and Obstacle Avoidance with Multi-agent Reinforcement Learning

2021-11-14 · Yuzi Yan, Xiaoxiang Li, Xinyou Qiu, Jiantao Qiu 외

Multi-agent formation as well as obstacle avoidance is one of the most actively studied topics in the field of multi-agent systems. Although some classic controllers like model predictive control (MPC) and fuzzy control …

Model Predictive Control Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

R-LAtte: Attention Module for Visual Control via Reinforcement Learning

2021-01-01 · Mandi Zhao, Qiyang Li, Aravind Srinivas, Ignasi Clavera 외

Attention mechanisms are generic inductive biases that have played a critical role in improving the state-of-the-art in supervised learning, unsupervised pre-training and generative modeling for multiple domains includin…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Unsupervised Pre-training

HypeMARL: Multi-Agent Reinforcement Learning For High-Dimensional, Parametric, and Distributed Systems

2025-09-20 · Nicolò Botteghi, Matteo Tomasetto, Urban Fasel, Francesco Braghin 외 arxiv

Deep reinforcement learning has recently emerged as a promising feedback control strategy for complex dynamical systems governed by partial differential equations (PDEs). When dealing with distributed, high-dimensional p…

Multi-agent Reinforcement Learning

Multi-agent reinforcement learning for the control of three-dimensional Rayleigh-Bénard convection

2024-07-31 · Joel Vasanth, Jean Rabault, Francisco Alcántara-Ávila, Mikael Mortensen 외

Deep reinforcement learning (DRL) has found application in numerous use-cases pertaining to flow control. Multi-agent RL (MARL), a variant of DRL, has shown to be more effective than single-agent RL in controlling flows …

Deep Reinforcement Learning Multi-agent Reinforcement Learning

Controllability in preference-conditioned multi-objective reinforcement learning

2026-05-11 · Pau de las Heras Molins, Beyazit Yalcinkaya, Lasse Peters, David Fridovich-Keil 외 arxiv

Multi-objective reinforcement learning (MORL) allows a user to express preference over outcomes in terms of the relative importance of the objectives, but standard metrics cannot capture whether changes in preference rel…

Reinforcement Learning