paper-with-me

Papers

Efficient and Explainable End-to-End Autonomous Driving via Masked Vision-Language-Action Diffusion

2026-02-24 · Jiaru Zhang, Manav Gagvani, Can Cui, Juntong Peng, Ruqi Zhang, Ziran Wang arxiv

Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged as promising candidates for end-to-end autonomous driving. However, these models typically face challenges in inference latency, action precision, and explainability. Existing autoregressive approaches struggle with slow token-by-token generation, while prior diffusion-based planners often rely on verbose, general-purpose language tokens that lack explicit geometric structure. In this work, we propose Masked Vision-Language-Action Diffusion for Autonomous Driving (MVLAD-AD), a novel framework designed to bridge the gap between efficient planning and semantic explainability via a masked vision-language-action diffusion model. Unlike methods that force actions into the language space, we introduce a discrete action tokenization strategy that constructs a compact codebook of kinematically feasible waypoints from real-world driving distributions. Moreover, we propose geometry-aware embedding learning to ensure that embeddings in the latent space approximate physical geometric metrics. Finally, an action-priority decoding strategy is introduced to prioritize trajectory generation. Extensive experiments on nuScenes and derived benchmarks demonstrate that MVLAD-AD achieves superior efficiency and outperforms state-of-the-art autoregressive and diffusion baselines in planning precision, while providing high-fidelity and explainable reasoning.

📄 PDF Abstract BibTeX arXiv:2602.20577

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Similar Papers 제목 키워드 기반

WAM-Diff: A Masked Diffusion VLA Framework with MoE and Online Reinforcement Learning for Autonomous Driving

2025-12-06 · Mingwang Xu, Jiahao Cui, Feipeng Cai, Hanlin Shang 외 arxiv

End-to-end autonomous driving systems based on vision-language-action (VLA) models integrate multimodal sensor inputs and language instructions to generate planning and control signals. While autoregressive large languag…

Visual Question AnsweringReinforcement LearningAutonomous Driving

LMAD: Integrated End-to-End Vision-Language Model for Explainable Autonomous Driving

2025-08-17 · Nan Song, Bozhou Zhang, Xiatian Zhu, Jiankang Deng 외 arxiv

Large vision-language models (VLMs) have shown promising capabilities in scene understanding, enhancing the explainability of driving behaviors and interactivity with users. Existing methods primarily fine-tune VLMs on o…

Scene UnderstandingAutonomous DrivingScene Recognition

Reason induced visual attention for explainable autonomous driving

2021-10-11 · Sikai Chen, Jiqian Dong, Runjia Du, Yujie Li 외

Deep learning (DL) based computer vision (CV) models are generally considered as black boxes due to poor interpretability. This limitation impedes efficient diagnoses or predictions of system failure, thereby precluding …

Autonomous Driving

MIM4D: Masked Modeling with Multi-View Video for Autonomous Driving Representation Learning

2024-03-13 · Jialv Zou, Bencheng Liao, Qian Zhang, Wenyu Liu 외

Learning robust and scalable visual representations from massive multi-view video data remains a challenge in computer vision and autonomous driving. Existing pre-training methods either rely on expensive supervised lear…

3D Object DetectionAutonomous DrivingBEV Segmentationobject-detection+2

RT-VLA: Real-Time Vision-Language-Action Models via Knowledge Distillation

2026-06-12 · Xiangyu Huang, Zhenlin Hua, Han Zhou, Shounak Sural 외 arxiv

Vision-Language-Action (VLA) models have shown strong potential for end-to-end autonomous driving by jointly modeling visual perception, language reasoning, explainability and action prediction. However, their large visi…

Knowledge DistillationAutonomous Driving