paper-with-me

Papers

TBD-VLA: Temporal Block Diffusion Vision Language Action Model

2026-06-05 · Sung-Wook Lee, Xuhui Kang, Yen-Ling Kuo arxiv

Discrete Vision-Language-Action (VLA) models typically formulate action generation as next-token prediction over discretized action spaces, conditioning each token autoregressively on prior context. While effective, this paradigm incurs high inference latency and largely ignores the temporal structure inherent in action trajectories. Recent efforts introduce parallel decoding to improve efficiency, enabling faster inference, but lack explicit mechanisms for modeling token dependencies. We introduce TBD-VLA, a discrete token-based VLA framework that incorporates block diffusion to enable temporal action generation. We partition action sequences into temporal blocks and perform masked discrete diffusion within each block, while maintaining autoregressive generation across blocks. This design unifies temporal autoregression and parallel action decoding, achieving both strong temporal coherence and improved inference speed. In addition, the explicit temporal modeling enables asynchronous execution of action chunks (e.g., Real-Time Chunking) via temporal in-painting. TBD-VLA significantly outperforms prior VLA approaches in both simulation and real-world manipulation tasks, offering a scalable path toward fast, temporally aware, discrete VLA models. Project webpage: https://tbd-vla.github.io/

📄 PDF Abstract BibTeX arXiv:2606.07895

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents

2026-09-09 · Zhangxuan Gu, Haoxing Chen, Qi Qin, Yi Xin 외 hf

Diffusion large language models (dLLMs) achieve high decoding efficiency through block-parallel, arbitrary-order generation, making them attractive for latency-sensitive applications. GUI agents represent a natural testb…

SDAR-VL: Stable and Efficient Block-wise Diffusion for Vision-Language Understanding

2025-12-16 · Shuang Cheng, Yuhua Jiang, Zineng Zhou, Dawei Liu 외 arxiv

Block-wise discrete diffusion offers an attractive balance between parallel generation and causal dependency modeling, making it a promising backbone for vision-language modeling. However, its practical adoption has been…

Block-wise Adaptive Caching for Accelerating Diffusion Policy

2025-06-16 · Kangye Ji, Yuan Meng, Hanyun Cui, Ye Li 외

Diffusion Policy has demonstrated strong visuomotor modeling capabilities, but its high computational cost renders it impractical for real-time robotic control. Despite huge redundancy across repetitive denoising steps, …

Action GenerationDenoisingVision-Language-Action

Masked Diffusion Vision-Language Models for Temporal Action Localization

2026-05-28 · Fengshun Wang, Zhengbo Zhang, Zhigang Tu arxiv

Temporal action localization (TAL) requires recognizing the target event and localizing its start and end times precisely in untrimmed videos. Recent vision-language formulations improve semantic reasoning and support la…

Temporal Action Localization

BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuning

2026-05-13 · Ruiheng Wang, Shuanghao Bai, Haoran Zhang, Badong Chen 외 arxiv

While autoregressive (AR) Vision-Language-Action (VLA) models have demonstrated formidable reasoning capabilities in robotic tasks, their sequential decoding process often incurs high inference latency and may amplify er…