paper-with-me

홈 › Papers

IntentionVLA: Generalizable and Efficient Embodied Intention Reasoning for Human-Robot Interaction

2025-10-09 · Yandu Chen, Kefan Gu, Yuqing Wen, Yucheng Zhao, Tiancai Wang, Liqiang Nie arxiv

Vision-Language-Action (VLA) models leverage pretrained vision-language models (VLMs) to couple perception with robotic control, offering a promising path toward general-purpose embodied intelligence. However, current SOTA VLAs are primarily pretrained on multimodal tasks with limited relevance to embodied scenarios, and then finetuned to map explicit instructions to actions. Consequently, due to the lack of reasoning-intensive pretraining and reasoning-guided manipulation, these models are unable to perform implicit human intention reasoning required for complex, real-world interactions. To overcome these limitations, we propose \textbf{IntentionVLA}, a VLA framework with a curriculum training paradigm and an efficient inference mechanism. Our proposed method first leverages carefully designed reasoning data that combine intention inference, spatial grounding, and compact embodied reasoning, endowing the model with both reasoning and perception capabilities. In the following finetuning stage, IntentionVLA employs the compact reasoning outputs as contextual guidance for action generation, enabling fast inference under indirect instructions. Experimental results show that IntentionVLA substantially outperforms $π_0$, achieving 18\% higher success rates with direct instructions and 28\% higher than ECoT under intention instructions. On out-of-distribution intention tasks, IntentionVLA achieves over twice the success rate of all baselines, and further enables zero-shot human-robot interaction with 40\% success rate. These results highlight IntentionVLA as a promising paradigm for next-generation human-robot interaction (HRI) systems.

📄 PDF Abstract BibTeX arXiv:2510.07778

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Infer Human's Intentions Before Following Natural Language Instructions

2024-09-26 · Yanming Wan, Yue Wu, Yiping Wang, Jiayuan Mao 외

For AI agents to be helpful to humans, they should be able to follow natural language instructions to complete everyday cooperative tasks in human environments. However, real human instructions inherently possess ambigui…

Instruction Following

ERQA-Plus: A Diagnostic Benchmark for Reasoning in Embodied AI

2026-06-16 · Hong Yang, Basura Fernando arxiv

Generalist embodied agents require more than object recognition: they must reason about spatial relations, actions, procedures, human intentions, environmental constraints, and commonsense consequences from situated visu…

Question GenerationObject RecognitionQuestion AnsweringSpatial Reasoning

DualVLA: Building a Generalizable Embodied Agent via Partial Decoupling of Reasoning and Action

2025-11-27 · Zhen Fang, Zhuoyang Liu, Jiaming Liu, Hao Chen 외 arxiv

To build a generalizable Vision-Language-Action (VLA) model with strong reasoning ability, a common strategy is to first train a specialist VLA on robot demonstrations to acquire reliable manipulation skills, and then in…

Embodied AI Agents: Modeling the World

2025-06-27 · Pascale Fung, Yoram Bachrach, Asli Celikyilmaz, Kamalika Chaudhuri 외

This paper describes our research on AI agents embodied in visual, virtual or physical forms, enabling them to interact with both users and their environments. These agents, which include virtual avatars, wearable device…

Human Agent Collaboration

MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention

2026-05-31 · Ruoxuan Zhang, Qiaoqiao Wan, Zhengguang Wang, Chenghao Yu 외 arxiv

Theory-of-Mind (ToM) reasoning enables embodied agents to understand human beliefs, goals, and intentions, but existing benchmarks mainly evaluate this ability through offline question answering or scenario-level action …

Question Answering