ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mind

2021-10-15 · NeurIPS 2021 12 · Yuanfei Wang, Fangwei Zhong, Jing Xu, Yizhou Wang

Being able to predict the mental states of others is a key factor to effective social interaction. It is also crucial for distributed multi-agent systems, where agents are required to communicate and cooperate. In this paper, we introduce such an important social-cognitive skill, i.e. Theory of Mind (ToM), to build socially intelligent agents who are able to communicate and cooperate effectively to accomplish challenging tasks. With ToM, each agent is capable of inferring the mental states and intentions of others according to its (local) observation. Based on the inferred states, the agents decide "when" and with "whom" to share their intentions. With the information observed, inferred, and received, the agents decide their sub-goals and reach a consensus among the team. In the end, the low-level executors independently take primitive actions to accomplish the sub-goals. We demonstrate the idea in two typical target-oriented multi-agent tasks: cooperative navigation and multi-sensor target coverage. The experiments show that the proposed model not only outperforms the state-of-the-art methods on reward and communication efficiency, but also shows good generalization across different scales of the environment.

📄 PDF Abstract BibTeX arXiv:2111.09189

Code (1)

unrealtracking/tom2c 공식 구현 pytorch

Characterizing Speed Performance of Multi-Agent Reinforcement Learning

2023-09-13 · Samuel Wiggins, Yuan Meng, Rajgopal Kannan, Viktor Prasanna

Multi-Agent Reinforcement Learning (MARL) has achieved significant success in large-scale AI systems and big-data applications such as smart grids, surveillance, etc. Existing advancements in MARL algorithms focus on imp…

CPU Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignment

2024-03-17 · Lance Ying, Kunal Jha, Shivam Aarya, Joshua B. Tenenbaum 외

Verbal communication plays a crucial role in human cooperation, particularly when the partners only have incomplete information about the task, environment, and each other's mental state. In this paper, we propose a nove…

Scalable Communication for Multi-Agent Reinforcement Learning via Transformer-Based Email Mechanism

2023-01-05 · Xudong Guo, Daming Shi, Wenhui Fan

Communication can impressively improve cooperation in multi-agent reinforcement learning (MARL), especially for partially-observed tasks. However, existing works either broadcast the messages leading to information redun…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Distributed Heuristic Multi-Agent Path Finding with Communication

2021-06-21 · Ziyuan Ma, Yudong Luo, Hang Ma

Multi-Agent Path Finding (MAPF) is essential to large-scale robotic systems. Recent methods have applied reinforcement learning (RL) to learn decentralized polices in partially observable environments. A fundamental chal…

Multi-Agent Path Finding Q-Learning Reinforcement Learning (RL)

Learning Attentional Communication for Multi-Agent Cooperation

2018-05-20 · NeurIPS 2018 12 · Jiechuan Jiang, Zongqing Lu

Communication could potentially be an effective way for multi-agent cooperation. However, information sharing among all agents or in predefined communication architectures that existing methods adopt can be problematic. …

Decision Making