ToMCAT: Theory-of-Mind for Cooperative Agents in Teams via Multiagent Diffusion Policies

2025-02-25 · Pedro Sequeira, Vidyasagar Sadhu, Melinda Gervasio

In this paper we present ToMCAT (Theory-of-Mind for Cooperative Agents in Teams), a new framework for generating ToM-conditioned trajectories. It combines a meta-learning mechanism, that performs ToM reasoning over teammates' underlying goals and future behavior, with a multiagent denoising-diffusion model, that generates plans for an agent and its teammates conditioned on both the agent's goals and its teammates' characteristics, as computed via ToM. We implemented an online planning system that dynamically samples new trajectories (replans) from the diffusion model whenever it detects a divergence between a previously generated plan and the current state of the world. We conducted several experiments using ToMCAT in a simulated cooking domain. Our results highlight the importance of the dynamic replanning mechanism in reducing the usage of resources without sacrificing team performance. We also show that recent observations about the world and teammates' behavior collected by an agent over the course of an episode combined with ToM inferences are crucial to generate team-aware plans for dynamic adaptation to teammates, especially when no prior information is provided about them.

📄 PDF Abstract BibTeX arXiv:2502.18438

Code (0)

등록된 구현이 없습니다.

Tasks

Denoising Meta-Learning

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Improving Multi-Agent Cooperation using Theory of Mind

2020-07-30 · Terence X. Lim, Sidney Tio, Desmond C. Ong

Recent advances in Artificial Intelligence have produced agents that can beat human world champions at games like Go, Starcraft, and Dota2. However, most of these models do not seem to play in a human-like manner: People…

Starcraft

The ToMCAT Dataset

2023-09-26 · NeurIPS 2023 11

We present a rich, multimodal dataset consisting of data from 40 teams of three humans conducting simulated urban search-and-rescue (SAR) missions in a Minecraft-based testbed, collected for the Theory of Mind-based Cogn…

Theory of Mind with Guilt Aversion Facilitates Cooperative Reinforcement Learning

2020-09-16 · Dung Nguyen, Svetha Venkatesh, Phuoc Nguyen, Truyen Tran

Guilt aversion induces experience of a utility loss in people if they believe they have disappointed others, and this promotes cooperative behaviour in human. In psychological game theory, guilt aversion necessitates mod…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Theory of Mind for Deep Reinforcement Learning in Hanabi

2021-01-22 · Andrew Fuchs, Michael Walton, Theresa Chadwick, Doug Lange

The partially observable card game Hanabi has recently been proposed as a new AI challenge problem due to its dependence on implicit communication conventions and apparent necessity of theory of mind reasoning for effici…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Probabilistic Modeling of Human Teams to Infer False Beliefs

2023-10-19 · Paulo Soares, Adarsh Pyarelal, Kobus Barnard

We develop a probabilistic graphical model (PGM) for artificially intelligent (AI) agents to infer human beliefs during a simulated urban search and rescue (USAR) scenario executed in a Minecraft environment with a team …

AI Agent Minecraft