Reinforcement Learning under a Multi-agent Predictive State Representation Model: Method and Theory
This paper proposes a new algorithm for learning the optimal policies under a novel multi-agent predictive state representation reinforcement learning model. Compared to the state-of-the-art methods, the most striking feature of our approach is the introduction of a dynamic interaction graph to the model, which allows us to represent each agent's predictive state by considering the behaviors of its ``neighborhood'' agents. Methodologically, we develop an online algorithm that simultaneously learns the predictive state representation and agent policies. Theoretically, we provide an upper bound of the $L_2$-norm of the learned predictive state representation. Empirically, to demonstrate the efficacy of the proposed method, we provide thorough numerical results on both a MAMuJoCo robotic learning experiment and a multi-agent particle learning environment.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
DeepSafeMPC: Deep Learning-Based Model Predictive Control for Safe Multi-Agent Reinforcement Learning
Safe Multi-agent reinforcement learning (safe MARL) has increasingly gained attention in recent years, emphasizing the need for agents to not only optimize the global return but also adhere to safety requirements through…
Model Predictive ControlMuJoCoMulti-agent Reinforcement Learningreinforcement-learning+1Efficient Deep Reinforcement Learning with Predictive Processing Proximal Policy Optimization
Advances in reinforcement learning (RL) often rely on massive compute resources and remain notoriously sample inefficient. In contrast, the human brain is able to efficiently learn effective control strategies using limi…
Atari GamesDeep Reinforcement LearningGPUreinforcement-learning+2P4O: Efficient Deep Reinforcement Learning with Predictive Processing Proximal Policy Optimization
Advances in reinforcement learning (RL) often rely on massive compute resources and remain notoriously sample inefficient. In contrast, the human brain is able to efficiently learn effective control strategies using limi…
Atari GamesDeep Reinforcement LearningGPUreinforcement-learning+2Self-Adapting Goals Allow Transfer of Predictive Models to New Tasks
A long-standing challenge in Reinforcement Learning is enabling agents to learn a model of their environment which can be transferred to solve other problems in a world with the same underlying rules. One reason this is …
Model-based Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Learning Predictive Communication by Imagination in Networked System Control
Dealing with multi-agent control in networked systems is one of the biggest challenges in Reinforcement Learning (RL) and limited success has been presented compared to recent deep reinforcement learning in single-agent …
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)