Improving Multi-Agent Cooperation using Theory of Mind
Recent advances in Artificial Intelligence have produced agents that can beat human world champions at games like Go, Starcraft, and Dota2. However, most of these models do not seem to play in a human-like manner: People infer others' intentions from their behaviour, and use these inferences in scheming and strategizing. Here, using a Bayesian Theory of Mind (ToM) approach, we investigated how much an explicit representation of others' intentions improves performance in a cooperative game. We compared the performance of humans playing with optimal-planning agents with and without ToM, in a cooperative game where players have to flexibly cooperate to achieve joint goals. We find that teams with ToM agents significantly outperform non-ToM agents when collaborating with all types of partners: non-ToM, ToM, as well as human players, and that the benefit of ToM increases the more ToM agents there are. These findings have implications for designing better cooperative agents.
Code (0)
등록된 구현이 없습니다.
Tasks
StarcraftSimilar Papers 제목 키워드 기반
Theory of Mind Using Active Inference: A Framework for Multi-Agent Cooperation
Theory of Mind (ToM) -- the ability to understand that others can have differing knowledge and goals -- enables agents to reason about others' beliefs while planning their own actions. We present a novel approach to mult…
Collision AvoidanceEmergence of Theory of Mind Collaboration in Multiagent Systems
Currently, in the study of multiagent systems, the intentions of agents are usually ignored. Nonetheless, as pointed out by Theory of Mind (ToM), people regularly reason about other's mental states, including beliefs, go…
Decision MakingCognitive Insights and Stable Coalition Matching for Fostering Multi-Agent Cooperation
Cognitive abilities, such as Theory of Mind (ToM), play a vital role in facilitating cooperation in human social interactions. However, our study reveals that agents with higher ToM abilities may not necessarily exhibit …
ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mind
Being able to predict the mental states of others is a key factor to effective social interaction. It is also crucial for distributed multi-agent systems, where agents are required to communicate and cooperate. In this p…
Emergence of Pragmatics from Referential Game between Theory of Mind Agents
Pragmatics studies how context can contribute to language meanings. In human communication, language is never interpreted out of context, and sentences can usually convey more information than their literal meanings. How…
Reinforcement LearningReinforcement Learning (RL)