paper-with-me

Papers

Vlaser: Vision-Language-Action Model with Synergistic Embodied Reasoning

2025-10-13 · Ganlin Yang, Tianyi Zhang, Haoran Hao, Weiyun Wang, Yibin Liu, Dehui Wang, Guanzhou Chen, Zijian Cai, Junting Chen, Weijie Su, Wengang Zhou, Yu Qiao, Jifeng Dai, Jiangmiao Pang, Gen Luo, Wenhai Wang, Yao Mu, Zhi Hou arxiv

While significant research has focused on developing embodied reasoning capabilities using Vision-Language Models (VLMs) or integrating advanced VLMs into Vision-Language-Action (VLA) models for end-to-end robot control, few studies directly address the critical gap between upstream VLM-based reasoning and downstream VLA policy learning. In this work, we take an initial step toward bridging embodied reasoning with VLA policy learning by introducing Vlaser - a Vision-Language-Action Model with synergistic embodied reasoning capability, which is a foundational vision-language model designed to integrate high-level reasoning with low-level control for embodied agents. Built upon the high-quality Vlaser-6M dataset, Vlaser achieves state-of-the-art performance across a range of embodied reasoning benchmarks - including spatial reasoning, embodied grounding, embodied QA, and task planning. Furthermore, we systematically examine how different VLM initializations affect supervised VLA fine-tuning, offering novel insights into mitigating the domain shift between internet-scale pre-training data and embodied-specific policy learning data. Based on these insights, our approach achieves state-of-the-art results on the WidowX benchmark and competitive performance on the Google Robot benchmark.

📄 PDF Abstract BibTeX arXiv:2510.11027

Code (0)

등록된 구현이 없습니다.

Tasks

Spatial Reasoning

Similar Papers 제목 키워드 기반

Improving Vision-and-Language Navigation with Image-Text Pairs from the Web

2020-04-30 · ECCV 2020 8 · Arjun Majumdar, Ayush Shrivastava, Stefan Lee, Peter Anderson 외

Following a navigation instruction such as 'Walk down the stairs and stop at the brown sofa' requires embodied AI agents to ground scene elements referenced via language (e.g. 'stairs') to visual content in the environme…

Vision and Language Navigation

ELITE: Experiential Learning and Intent-Aware Transfer for Self-improving Embodied Agents

2026-03-25 · Bingqing Wei, Zhongyu Xia, Dingai Liu, Xiaoyu Zhou 외 arxiv

Vision-language models (VLMs) have shown remarkable general capabilities, yet embodied agents built on them fail at complex tasks, often skipping critical steps, proposing invalid actions, and repeating mistakes. These f…

GigaWorld-0: World Models as Data Engine to Empower Embodied AI

2025-11-25 · GigaWorld Team, Angen Ye, Boyuan Wang, Chaojun Ni 외 arxiv

World models are emerging as a foundational paradigm for scalable, data-efficient embodied AI. In this work, we present GigaWorld-0, a unified world model framework designed explicitly as a data engine for Vision-Languag…

Video GenerationMotion Planning

OmniVLA-RL: A Vision-Language-Action Model with Spatial Understanding and Online RL

2026-04-20 · Haoxiang Jie, Yaoyuan Yan, Xiangyu Wei, Kailin Wang 외 arxiv

Visual-Language-Action (VLA) models represent a paradigm shift in embodied AI, yet existing frameworks often struggle with imprecise spatial perception, suboptimal multimodal fusion, and instability in reinforcement lear…

Reinforcement Learning

Plan in Sandbox, Navigate in Open Worlds: Learning Physics-Grounded Abstracted Experience for Embodied Navigation

2026-05-11 · Zhixuan Shen, Jiawei Du, Ziyu Guo, Han Luo 외 arxiv

Vision-Language Models (VLMs) have demonstrated exceptional general reasoning capabilities. However, their performance in embodied navigation remains hindered by a scarcity of aligned open-world vision and robot control …

Reinforcement Learning