Are you with me? A Framework for Detecting Mental Model Discrepancies in Task-Based Team Dialogues
Humans typically use natural language to update teammates on task states. Since not all updates are communicated, discrepancies arise between the team members' mental models that negatively affect overall team performance. How can we categorize such discrepancies? Do misalignments detected in team dialogue predict future mental model misalignments? Traditional shared mental model (SMM) assessment methods rely on retrospective expert coding that cannot capture real-time coordination dynamics. We propose a framework to identify and categorize four types of mental model discrepancies: unsupported beliefs, false beliefs, belief contradictions, and omissions, all of which can naturally emerge in team dialogues. Using dialogues from twenty dyad teams performing collaborative object identification tasks across four sequential levels, we demonstrate that these discrepancy patterns contain predictive signals. Averaging historical discrepancy counts achieves meaningful prediction accuracy using uniform weighting as an exploratory baseline, with differential predictability across discrepancy types.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
LLMs and their Limited Theory of Mind: Evaluating Mental State Annotations in Situated Dialogue
What if large language models could not only infer human mindsets but also expose every blind spot in team dialogue such as discrepancies in the team members' joint understanding? We present a novel, two-step framework t…
Coherence EvaluationSpatial ReasoningVisual and audio scene classification for detecting discrepancies in video: a baseline method and experimental protocol
This paper presents a baseline approach and an experimental protocol for a specific content verification problem: detecting discrepancies between the audio and video modalities in multimedia content. We first design and …
Scene ClassificationAdaptation and Communication in Human-Robot Teaming to Handle Discrepancies in Agents' Beliefs about Plans
When agents collaborate on a task, it is important that they have some shared mental model of the task routines -- the set of feasible plans towards achieving the goals. However, in reality, situations often arise that s…
ORION: Option-Regularized Deep Reinforcement Learning for Cooperative Multi-Agent Online Navigation
Existing methods for multi-agent navigation typically assume fully known environments, offering limited support for partially known scenarios with outdated or imperfect prior maps, such as warehouses or factory floors. T…
Reinforcement Learninghub at SemEval-2021 Task 7: Fusion of ALBERT and Word Frequency Information Detecting and Rating Humor and Offense
This paper introduces the system description of the hub team, which explains the related work and experimental results of our team{'}s participation in SemEval 2021 Task 7: HaHackathon: Detecting and Rating Humor and Off…
Humor DetectionregressionSentencetext-classification+1