paper-with-me

홈 › Papers

Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localization

2026-06-04 · Ayano Hiranaka, Ya-Chuan Hsu, Stefanos Nikolaidis, Erdem Bıyık, Daniel Seita arxiv

AI assistants in human-AI collaboration often correct suboptimal human actions through behavioral feedback (e.g., alerts or steering-wheel nudges in assistive driving). Such interventions can mitigate immediate errors, but long-term improvement requires addressing the underlying misconceptions that cause repeated mistakes. We introduce SENSEI, a framework that infers user misconceptions from interaction behavior and provides targeted, minimal yet sufficient suggestions to correct them. Our approach departs from action- or trajectory-level interventions by operating over a structured knowledge representation to localize and correct the sources of erroneous behavior. Across three long-horizon tasks with diverse misconceptions and corresponding behaviors, SENSEI demonstrates zero-shot compositional generalization, disentangling multiple overlapping misconceptions despite training only on single-misconception cases. A user study further shows that our method identifies real human misconceptions and provides effective guidance that improves long-horizon task performance, successfully correcting $90\%$ of student misconceptions. Code and project page are available at https://misoshiruseijin.github.io/SENSEI/.

📄 PDF Abstract BibTeX arXiv:2606.05602

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Knowledge Driven Approach to Adaptive Assistance Using Preference Reasoning and Explanation

2020-12-05 · Jason R. Wilson, Leilani Gilpin, Irina Rabkina

There is a need for socially assistive robots (SARs) to provide transparency in their behavior by explaining their reasoning. Additionally, the reasoning and explanation should represent the user's preferences and goals.…

MIND-Stack: Modular, Interpretable, End-to-End Differentiability for Autonomous Navigation

2025-05-27 · Felix Jahncke, Johannes Betz

Developing robust, efficient navigation algorithms is challenging. Rule-based methods offer interpretability and modularity but struggle with learning from large datasets, while end-to-end neural networks excel in learni…

Autonomous NavigationState Estimation

Training-Free Tunnel Defect Inspection and Engineering Interpretation via Visual Recalibration and Entity Reconstruction

2026-04-30 · Shipeng Liu, Liang Zhao, Dengfeng Chen, Zhanping Song arxiv

Tunnel inspection requires outputs that can support defect localization, measurement, severity grading, and engineering documentation. Existing training-free foundation-model pipelines usually stop at coarse open-vocabul…

Deep Interpretable Models of Theory of Mind

2021-04-07 · Ini Oguntola, Dana Hughes, Katia Sycara

When developing AI systems that interact with humans, it is essential to design both a system that can understand humans, and a system that humans can understand. Most deep network based agent-modeling approaches are 1) …

Minecraft

Visual Graph Scaffolds for Structural Reasoning in Large Language Models

2026-06-01 · Runlin Lei, Xiaokui Xiao, Zhewei Wei arxiv

Graphs have been used to enhance large language models (LLMs) for structured reasoning, mostly as external knowledge sources are provided to models at test time. In this paper, we take a different view: the value of grap…

Multi-hop Question Answering