Fully Decentralized Model-based Policy Optimization with Networked Agents

2021-09-29 · Yuchen Liu, Yali Du, Runji Lin, Hangrui Bi, Mingdong Wu, Jun Wang, Hao Dong

Model-based RL is an effective approach for reducing sample complexity. However, when it comes to multi-agent setting where the number of agent is large, the model estimation can be problematic due to the exponential increased interactions. In this paper, we propose a decentralized model-based reinforcement learning algorithm for networked multi-agent systems, where agents are cooperative and communicate locally with their neighbors. We analyze our algorithm theoretically and derive an upper bound of performance discrepancy caused by model usage, and provide a sufficient condition of monotonic policy improvement. In our experiments, we compare our algorithm against other strong multi-agent baselines and demonstrate that our algorithm not only matches the asymptotic performance of model-free methods but also largely increases its sample efficiency.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Model-based Reinforcement LearningReinforcement Learning (RL)

Learning to Share in Multi-Agent Reinforcement Learning

2021-12-16 · Yuxuan Yi, Ge Li, YaoWei Wang, Zongqing Lu

In this paper, we study the problem of networked multi-agent reinforcement learning (MARL), where a number of agents are deployed as a partially connected network and each interacts only with nearby agents. Networked MAR…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Value Propagation for Decentralized Networked Deep Multi-agent Reinforcement Learning

2019-01-27 · NeurIPS 2019 12 · Chao Qu, Shie Mannor, Huan Xu, Yuan Qi 외

We consider the networked multi-agent reinforcement learning (MARL) problem in a fully decentralized setting, where agents learn to coordinate to achieve the joint success. This problem is widely encountered in many area…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning-Augmented Decentralized Online Convex Optimization in Networks

2023-06-16 · Pengfei Li, Jianyi Yang, Adam Wierman, Shaolei Ren

This paper studies decentralized online convex optimization in a networked multi-agent system and proposes a novel algorithm, Learning-Augmented Decentralized Online optimization (LADO), for individual agents to select a…

Bayesian Ego-graph Inference for Networked Multi-Agent Reinforcement Learning

2025-09-20 · Wei Duan, Jie Lu, Junyu Xuan arxiv

In networked multi-agent reinforcement learning (Networked-MARL), decentralized agents must act under local observability and constrained communication over fixed physical graphs. Existing methods often assume static nei…

Multi-agent Reinforcement Learning

Fully-Decentralized MADDPG with Networked Agents

2025-03-09 · Diego Bolliger, Lorenz Zauter, Robert Ziegler

In this paper, we devise three actor-critic algorithms with decentralized training for multi-agent reinforcement learning in cooperative, adversarial, and mixed settings with continuous action spaces. To this goal, we ad…