Neighborhood Cognition Consistent Multi-Agent Reinforcement Learning

2019-12-03 · Hangyu Mao, Wulong Liu, Jianye Hao, Jun Luo, Dong Li, Zhengchao Zhang, Jun Wang, Zhen Xiao

Social psychology and real experiences show that cognitive consistency plays an important role to keep human society in order: if people have a more consistent cognition about their environments, they are more likely to achieve better cooperation. Meanwhile, only cognitive consistency within a neighborhood matters because humans only interact directly with their neighbors. Inspired by these observations, we take the first step to introduce \emph{neighborhood cognitive consistency} (NCC) into multi-agent reinforcement learning (MARL). Our NCC design is quite general and can be easily combined with existing MARL methods. As examples, we propose neighborhood cognition consistent deep Q-learning and Actor-Critic to facilitate large-scale multi-agent cooperations. Extensive experiments on several challenging tasks (i.e., packet routing, wifi configuration, and Google football player control) justify the superior performance of our methods compared with state-of-the-art MARL approaches.

📄 PDF Abstract BibTeX arXiv:1912.01160

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement LearningQ-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Partially Observable Mean Field Multi-Agent Reinforcement Learning Based on Graph-Attention

2023-04-25 · Min Yang, Guanjun Liu, Ziyuan Zhou

Traditional multi-agent reinforcement learning algorithms are difficultly applied in a large-scale multi-agent environment. The introduction of mean field theory has enhanced the scalability of multi-agent reinforcement …

Graph Attention Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

MARL-LNS: Cooperative Multi-agent Reinforcement Learning via Large Neighborhoods Search

2024-04-03 · Weizhe Chen, Sven Koenig, Bistra Dilkina

Cooperative multi-agent reinforcement learning (MARL) has been an increasingly important research topic in the last half-decade because of its great potential for real-world applications. Because of the curse of dimensio…

Multi-agent Reinforcement Learning Starcraft

Scalable Multi-Agent Reinforcement Learning through Intelligent Information Aggregation

2022-11-03 · Siddharth Nayak, Kenneth Choi, Wenqi Ding, Sydney Dolan 외

We consider the problem of multi-agent navigation and collision avoidance when observations are limited to the local neighborhood of each agent. We propose InforMARL, a novel architecture for multi-agent reinforcement le…

Collision Avoidance Graph Neural Network Multi-agent Reinforcement Learning reinforcement-learning+2

Towards Generalizability of Multi-Agent Reinforcement Learning in Graphs with Recurrent Message Passing

2024-02-07 · Jannis Weil, Zhenghua Bao, Osama Abboud, Tobias Meuser

Graph-based environments pose unique challenges to multi-agent reinforcement learning. In decentralized approaches, agents operate within a given graph and make decisions based on partial or outdated observations. The si…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Towards Resilience for Multi-Agent $QD$-Learning

2021-04-07 · Yijing Xie, Shaoshuai Mou, Shreyas Sundaram

This paper considers the multi-agent reinforcement learning (MARL) problem for a networked (peer-to-peer) system in the presence of Byzantine agents. We build on an existing distributed $Q$-learning algorithm, and allow …

All Multi-agent Reinforcement Learning Q-Learning