paper-with-me

Papers

InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policy

2025-10-15 · Xinyi Chen, Yilun Chen, Yanwei Fu, Ning Gao, Jiaya Jia, Weiyang Jin, Hao Li, Yao Mu, Jiangmiao Pang, Yu Qiao, Yang Tian, Bin Wang, Bolun Wang, Fangjing Wang, Hanqing Wang, Tai Wang, Ziqin Wang, Xueyuan Wei, Chao Wu, Shuai Yang, Jinhui Ye, Junqiu Yu, Jia Zeng, Jingjing Zhang, Jinyu Zhang, Shi Zhang, Feng Zheng, Bowen Zhou, Yangkun Zhu arxiv

We introduce InternVLA-M1, a unified framework for spatial grounding and robot control that advances instruction-following robots toward scalable, general-purpose intelligence. Its core idea is spatially guided vision-language-action training, where spatial grounding serves as the critical link between instructions and robot actions. InternVLA-M1 employs a two-stage pipeline: (i) spatial grounding pre-training on over 2.3M spatial reasoning data to determine `where to act'' by aligning instructions with visual, embodiment-agnostic positions, and (ii) spatially guided action post-training to decide `how to act'' by generating embodiment-aware actions through plug-and-play spatial prompting. This spatially guided training recipe yields consistent gains: InternVLA-M1 outperforms its variant without spatial guidance by +14.6% on SimplerEnv Google Robot, +17% on WidowX, and +4.3% on LIBERO Franka, while demonstrating stronger spatial reasoning capability in box, point, and trace prediction. To further scale instruction following, we built a simulation engine to collect 244K generalizable pick-and-place episodes, enabling a 6.2% average improvement across 200 tasks and 3K+ objects. In real-world clustered pick-and-place, InternVLA-M1 improved by 7.3%, and with synthetic co-training, achieved +20.6% on unseen objects and novel configurations. Moreover, in long-horizon reasoning-intensive scenarios, it surpassed existing works by over 10%. These results highlight spatially guided training as a unifying principle for scalable and resilient generalist robots. Code and models are available at https://github.com/InternRobotics/InternVLA-M1.

📄 PDF Abstract BibTeX arXiv:2510.13778

Code (0)

등록된 구현이 없습니다.

Tasks

Instruction FollowingSpatial Reasoning

Similar Papers 제목 키워드 기반

ST4VLA: Spatially Guided Training for Vision-Language-Action Models

2026-02-10 · Jinhui Ye, Fangjing Wang, Ning Gao, Junqiu Yu 외 arxiv

Large vision-language models (VLMs) excel at multimodal understanding but fall short when extended to embodied tasks, where instructions must be transformed into low-level motor actions. We introduce ST4VLA, a dual-syste…

Trajectory Prediction

InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulation

2026-01-05 · Junhao Cai, Zetao Cai, Jiafei Cao, Yilun Chen 외 arxiv

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability t…

Scene UnderstandingVideo Prediction

InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalization

2026-07-06 · Haoxiang Ma, Junhao Cai, Xiaoxu Xu, Hao Li 외 arxiv

Unified models for robot manipulation aim to equip one policy with both the semantic priors of pretrained VLMs and the physical dynamics learned through future prediction. In practice, existing designs tend to erode the …

Robot ManipulationVideo Generation

NavCMPO: Critic-Guided MeanFlow Policy Optimization for Adaptive Navigation

2026-07-16 · Junjie An, Yi Wu, Xiao Liu, Yiqun Zhou 외 arxiv

End-to-end diffusion-based policies have demonstrated strong performance in mapless visual navigation, but their iterative denoising process introduces substantial inference latency, while behavior cloning limits perform…

Reinforcement LearningVisual Navigation

LAVIFT: Latent-Action-Guided Vision Fine-Tuning for Surgical Interaction Recognition

2026-07-22 · Jiajun Cheng, Subarna Tripathi, Sainan Liu, Xiaofan Yu 외 arxiv

Understanding instrument-tissue interactions is essential for context-aware surgical AI and autonomous robotic surgery. Pretrained vision-language models (VLMs) and vision encoders offer an alternative to conventional in…