paper-with-me

Papers

AR-VLA: True Autoregressive Action Expert for Vision-Language-Action Models

2026-03-10 · Yutong Hu, Jan-Nico Zaech, Nikolay Nikolov, Yuanqi Yao, Sombit Dey, Giuliano Albanese, Renaud Detry, Luc Van Gool, Danda Paudel arxiv

We propose a standalone autoregressive (AR) Action Expert that generates actions as a continuous causal sequence while conditioning on refreshable vision-language prefixes. In contrast to existing Vision-Language-Action (VLA) models and diffusion policies that reset temporal context with each new observation and predict actions reactively, our Action Expert maintains its own history through a long-lived memory and is inherently context-aware. This structure addresses the frequency mismatch between fast control and slow reasoning, enabling efficient independent pretraining of kinematic syntax and modular integration with heavy perception backbones, naturally ensuring spatio-temporally consistent action generation across frames. To synchronize these asynchronous hybrid V-L-A modalities, we utilize a re-anchoring mechanism that mathematically accounts for perception staleness during both training and inference. Experiments on simulated and real-robot manipulation tasks demonstrate that the proposed method can effectively replace traditional chunk-based action heads for both specialist and generalist policies. AR-VLA exhibits superior history awareness and substantially smoother action trajectories while maintaining or exceeding the task success rates of state-of-the-art reactive VLAs. Overall, our work introduces a scalable, context-aware action generation schema that provides a robust structural foundation for training effective robotic policies. Code and Videos available at https://arvla.insait.ai

📄 PDF Abstract BibTeX arXiv:2603.10126

Code (0)

등록된 구현이 없습니다.

Tasks

Robot Manipulation

Similar Papers 제목 키워드 기반

FASTer: Toward Efficient Autoregressive Vision Language Action Modeling via Neural Action Tokenization

2025-12-04 · Yicheng Liu, Shiduo Zhang, Zibin Dong, Baijun Ye 외 arxiv

Autoregressive vision-language-action (VLA) models have recently demonstrated strong capabilities in robotic manipulation. However, their core process of action tokenization often involves a trade-off between reconstruct…

AR-Omni: A Unified Autoregressive Model for Any-to-Any Generation

2026-01-25 · Dongjie Cheng, Ruifeng Yuan, Yongqi Li, Runyang You 외 arxiv

Real-world perception and interaction are inherently multimodal, encompassing not only language but also vision and speech, which motivates the development of "Omni" MLLMs that support both multimodal inputs and multimod…

multimodal generationImage Generation

SpanVLA: Efficient Action Bridging and Learning from Negative-Recovery Samples for Vision-Language-Action Model

2026-04-21 · Zewei Zhou, Ruining Yang, Xuewei, Qi 외 arxiv

Vision-Language-Action (VLA) models offer a promising autonomous driving paradigm for leveraging world knowledge and reasoning capabilities, especially in long-tail scenarios. However, existing VLA models often struggle …

Autonomous Driving

Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-training

2024-05-06 · Zexuan Zhong, Mengzhou Xia, Danqi Chen, Mike Lewis

Mixture-of-experts (MoE) models facilitate efficient scaling; however, training the router network introduces the challenge of optimizing a non-differentiable, discrete objective. Recently, a fully-differentiable MoE arc…

Language ModelingLanguage ModellingMixture-of-Experts

CubeDAgger: Improved Robustness of Interactive Imitation Learning without Violation of Dynamic Stability

2025-05-08 · Taisuke Kobayashi

Interactive imitation learning makes an agent's control policy robust by stepwise supervisions from an expert. The recent algorithms mostly employ expert-agent switching systems to reduce the expert's burden by limitedly…

Imitation Learning