paper-with-me

홈 › Papers

Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failures

2026-03-01 · Yuechen Luo, Qimao Chen, Fang Li, Shaoqing Xu, Jaxin Liu, Ziying Song, Zhi-xin Yang, Fuxi Wen arxiv

Vision-Language-Action (VLA) models for autonomous driving often hit a performance plateau during Reinforcement Learning (RL) optimization. This stagnation arises from exploration capabilities constrained by previous Supervised Fine-Tuning (SFT), leading to persistent failures in long-tail scenarios. In these critical situations, all explored actions yield a zero-value driving score. This information-sparse reward signals a failure, yet fails to identify its root cause -- whether it is due to incorrect planning, flawed reasoning, or poor trajectory execution. To address this limitation, we propose VLA with Explicit Learning from Failures (ELF-VLA), a framework that augments RL with structured diagnostic feedback. Instead of relying on a vague scalar reward, our method produces detailed, interpretable reports that identify the specific failure mode. The VLA policy then leverages this explicit feedback to generate a Feedback-Guided Refinement. By injecting these corrected, high-reward samples back into the RL training batch, our approach provides a targeted gradient, which enables the policy to solve critical scenarios that unguided exploration cannot. Extensive experiments demonstrate that our method unlocks the latent capabilities of VLA models, achieving state-of-the-art (SOTA) performance on the public NAVSIM benchmark for overall PDMS, EPDMS score and high-level planning accuracy.

📄 PDF Abstract BibTeX arXiv:2603.01063

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningAutonomous Driving

Similar Papers 제목 키워드 기반

DriveSafer: End-to-End Autonomous Driving with Safety Guidance

2026-05-16 · Shounak Sural, Raj Rajkumar arxiv

End-to-End (E2E) autonomous driving models have shown growing capability in recent years, with performance improving on increasingly challenging benchmarks. However, modern generative E2E planners still suffer from a sub…

Autonomous Driving

RGB cameras failures and their effects in autonomous driving applications

2020-08-13 · Francesco Secci, Andrea Ceccarelli

RGB cameras are one of the most relevant sensors for autonomous driving applications. It is undeniable that failures of vehicle cameras may compromise the autonomous driving task, possibly leading to unsafe behaviors whe…

Autonomous Driving

Interpretable Safety Validation for Autonomous Vehicles

2020-04-14 · Anthony Corso, Mykel J. Kochenderfer

An open problem for autonomous driving is how to validate the safety of an autonomous vehicle in simulation. Automated testing procedures can find failures of an autonomous system but these failures may be difficult to i…

Autonomous DrivingAutonomous Vehicles

AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning

2025-03-10 · Bo Jiang, Shaoyu Chen, Qian Zhang, Wenyu Liu 외

OpenAI o1 and DeepSeek R1 achieve or even surpass human expert-level performance in complex domains like mathematics and science, with reinforcement learning (RL) and reasoning playing a crucial role. In autonomous drivi…

Autonomous DrivingCommon Sense ReasoningReinforcement Learning (RL)

Unleashing the Potential of Diffusion Models for End-to-End Autonomous Driving

2026-02-26 · Yinan Zheng, Tianyi Tan, Bin Huang, Enguang Liu 외 arxiv

Diffusion models have become a popular choice for decision-making tasks in robotics, and more recently, are also being considered for solving autonomous driving tasks. However, their applications and evaluations in auton…

Reinforcement LearningAutonomous Driving