paper-with-me

Papers

InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulation

2026-01-05 · Junhao Cai, Zetao Cai, Jiafei Cao, Yilun Chen, Zeyu He, Lei Jiang, Hang Li, Hengjie Li, Yang Li, Yufei Liu, Yanan Lu, Qi Lv, Haoxiang Ma, Jiangmiao Pang, Yu Qiao, Zherui Qiu, Yanqing Shen, Xu Shi, Yang Tian, Bolun Wang, Hanqing Wang, Jiaheng Wang, Tai Wang, Xueyuan Wei, Chao Wu, Yiman Xie, Boyang Xing, Yuqiang Yang, Yuyin Yang, Qiaojun Yu, Feng Yuan, Jia Zeng, Jingjing Zhang, Shenghan Zhang, Shi Zhang, Zhuoma Zhaxi, Bowen Zhou, Yuanzhen Zhou, Yunsong Zhou, Hongrui Zhu, Yangkun Zhu, Yuchen Zhu arxiv

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability to deduce physical world dynamics. Consequently, recent approaches have shifted toward World Models, typically formulated via video prediction; however, these methods often suffer from a lack of semantic grounding and exhibit brittleness in the presence of video prediction errors. To synergize semantic understanding with dynamic predictive capabilities, we present InternVLA-A1. This model employs a unified Mixture-of-Transformers architecture, coordinating three experts for scene understanding, visual foresight generation, and action execution. These components interact seamlessly through a unified masked self attention mechanism. Building upon InternVL3 and Qwen3-VL, we instantiate InternVLA-A1 at 2B and 3B parameter scales. We pre-train these models on heterogeneous data sources over real-world robot data, synthetic simulation data, and human videos, covering over 692M frames. This hybrid training strategy effectively harnesses the diversity of synthetic simulation data while minimizing the sim-to-real gap. We evaluated InternVLA-A1 on 12 real-world robotic tasks and a simulation benchmark. The results show that InternVLA-A1 consistently outperforms prior leading models: compared with pi0.5, it achieves +4.4\% on static manipulation tasks and +2.6\% on the RoboTwin 2.0 simulation benchmark, and delivers a +26.7\% boost on dynamic manipulation tasks.

📄 PDF Abstract BibTeX arXiv:2601.02456

Code (0)

등록된 구현이 없습니다.

Tasks

Scene UnderstandingVideo Prediction

Similar Papers 제목 키워드 기반

InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policy

2025-10-15 · Xinyi Chen, Yilun Chen, Yanwei Fu, Ning Gao 외 arxiv

We introduce InternVLA-M1, a unified framework for spatial grounding and robot control that advances instruction-following robots toward scalable, general-purpose intelligence. Its core idea is spatially guided vision-la…

Instruction FollowingSpatial Reasoning

InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalization

2026-07-06 · Haoxiang Ma, Junhao Cai, Xiaoxu Xu, Hao Li 외 arxiv

Unified models for robot manipulation aim to equip one policy with both the semantic priors of pretrained VLMs and the physical dynamics learned through future prediction. In practice, existing designs tend to erode the …

Robot ManipulationVideo Generation

ST4VLA: Spatially Guided Training for Vision-Language-Action Models

2026-02-10 · Jinhui Ye, Fangjing Wang, Ning Gao, Junqiu Yu 외 arxiv

Large vision-language models (VLMs) excel at multimodal understanding but fall short when extended to embodied tasks, where instructions must be transformed into low-level motor actions. We introduce ST4VLA, a dual-syste…

Trajectory Prediction

Motus: A Unified Latent Action World Model

2025-12-15 · Hongzhe Bi, Hengkai Tan, Shenghao Xie, Zeyuan Wang 외 arxiv

While a general embodied agent must function as a unified system, current methods are built on isolated models for understanding, world modeling, and control. This fragmentation prevents unifying multimodal generative ca…

Video Generation

Unifying Perception and Action: A Hybrid-Modality Pipeline with Implicit Visual Chain-of-Thought for Robotic Action Generation

2025-11-25 · Xiangkai Ma, Lekai Xing, Han Zhang, Wenzhong Li 외 arxiv

Vision-Language-Action (VLA) models built upon Chain-of-Thought (CoT) have achieved remarkable success in advancing general-purpose robotic agents, owing to its significant perceptual comprehension. Recently, since text-…

Motion Planning