paper-with-me

홈 › Papers

GigaBrain-0.5M*: a VLA That Learns From World Model-Based Reinforcement Learning

2026-02-12 · GigaBrain Team, Boyuan Wang, Bohan Li, Chaojun Ni, Guan Huang, Guosheng Zhao, Hao Li, Jie Li, Jindi Lv, Jingyu Liu, Lv Feng, Mingming Yu, Peng Li, Qiuping Deng, Tianze Liu, Xinyu Zhou, Xinze Chen, Xiaofeng Wang, Yang Wang, Yifan Li, Yifei Nie, Yilong Li, Yukun Zhou, Yun Ye, Zhichao Liu, Zheng Zhu arxiv

Vision-language-action (VLA) models that directly predict multi-step action chunks from current observations face inherent limitations due to constrained scene understanding and weak future anticipation capabilities. In contrast, video world models pre-trained on web-scale video corpora exhibit robust spatiotemporal reasoning and accurate future prediction, making them a natural foundation for enhancing VLA learning. Therefore, we propose \textit{GigaBrain-0.5M*}, a VLA model trained via world model-based reinforcement learning. Built upon \textit{GigaBrain-0.5}, which is pre-trained on over 10,000 hours of robotic manipulation data, whose intermediate version currently ranks first on the international RoboChallenge benchmark. \textit{GigaBrain-0.5M*} further integrates world model-based reinforcement learning via \textit{RAMP} (Reinforcement leArning via world Model-conditioned Policy) to enable robust cross-task adaptation. Empirical results demonstrate that \textit{RAMP} achieves substantial performance gains over the RECAP baseline, yielding improvements of approximately 30\% on challenging tasks including \texttt{Laundry Folding}, \texttt{Box Packing}, and \texttt{Espresso Preparation}. Critically, \textit{GigaBrain-0.5M$^*$} exhibits reliable long-horizon execution, consistently accomplishing complex manipulation tasks without failure as validated by real-world deployment videos on our \href{https://gigabrain05m.github.io}{project page}.

📄 PDF Abstract BibTeX arXiv:2602.12099

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningScene Understanding

Similar Papers 제목 키워드 기반

GigaBrain-0: A World Model-Powered Vision-Language-Action Model

2025-10-22 · GigaBrain Team, Angen Ye, Boyuan Wang, Chaojun Ni 외 arxiv

Training Vision-Language-Action (VLA) models for generalist robots typically requires large-scale real-world robot data, which is expensive and time-consuming to collect. The inefficiency of physical data collection seve…

Video Generation

GigaBrain-0.7: Scaling Embodied Foundation Models to Emergent Capabilities with a Three-System Architecture

2026-08-16 · GigaBrain Team, Angen Ye, Axiang Sun, Can Jin 외 hf

Vision-language-action (VLA) models have become a dominant paradigm for generalist embodied agents, demonstrating strong complex and long-horizon task completion in structured settings. Yet it remains an open question wh…

Instruction Following

GigaWorld-0: World Models as Data Engine to Empower Embodied AI

2025-11-25 · GigaWorld Team, Angen Ye, Boyuan Wang, Chaojun Ni 외 arxiv

World models are emerging as a foundational paradigm for scalable, data-efficient embodied AI. In this work, we present GigaWorld-0, a unified world model framework designed explicitly as a data engine for Vision-Languag…

Video GenerationMotion Planning

GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluation

2026-07-02 · GigaWorld Team, Angyuan Ma, Boyuan Wang, Bohan Li 외 hf

Evaluating embodied robot foundation models remains a critical bottleneck; unlike large language models efficiently assessed via digital benchmarks, robotic policies require slow, costly real-world rollouts limited by ha…

Automating Reinforcement Learning with Example-based Resets

2022-04-05 · Jigang Kim, J. Hyeon Park, Daesol Cho, H. Jin Kim

Deep reinforcement learning has enabled robots to learn motor skills from environmental interactions with minimal to no prior knowledge. However, existing reinforcement learning algorithms assume an episodic setting, in …

continuous-controlContinuous ControlDeep Reinforcement Learningreinforcement-learning+2