paper-with-me

Papers

Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLA

2026-04-03 · Zihua Wang, Zhitao Lin, Ruibo Li, Yu Zhang, Xu Yang, Siya Mi, Xiu-Shen Wei arxiv

Vision-Language-Action (VLA) models, as large foundation models for embodied control, have shown strong performance in manipulation tasks. However, their performance comes at high inference cost. To improve efficiency, recent methods adopt action chunking, which predicts a sequence of future actions for open-loop execution. Although effective for reducing computation, open-loop execution is sensitive to environmental changes and prone to error accumulation due to the lack of close-loop feedback. To address this limitation, we propose Speculative Verification for VLA Control (SV-VLA), a framework that combines efficient open-loop long-horizon planning with lightweight closed-loop online verification. Specifically, SV-VLA uses a heavy VLA as a low-frequency macro-planner to generate an action chunk together with a planning context, while a lightweight verifier continuously monitors execution based on the latest observations. Conditioned on both the current observation and the planning context, the verifier compares the planned action against a closed-loop reference action and triggers replanning only when necessary. Experiments demonstrate that SV-VLA combines the efficiency of chunked prediction with the robustness of closed-loop control, enabling efficient and reliable VLA-based control in dynamic environments. Code is available: https://github.com/edsad122/SV-VLA.

📄 PDF Abstract BibTeX arXiv:2604.02965

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Hydra-NeXt: Robust Closed-Loop Driving with Open-Loop Training

2025-03-15 · Zhenxin Li, Shihao Wang, Shiyi Lan, Zhiding Yu 외

End-to-end autonomous driving research currently faces a critical challenge in bridging the gap between open-loop training and closed-loop deployment. Current approaches are trained to predict trajectories in an open-loo…

Autonomous DrivingBench2DriveNavSimTrajectory Prediction

NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles

2021-06-22 · Holger Caesar, Juraj Kabzan, Kok Seang Tan, Whye Kit Fong 외

In this work, we propose the world's first closed-loop ML-based planning benchmark for autonomous driving. While there is a growing body of ML-based motion planners, the lack of established datasets and metrics has limit…

Autonomous DrivingAutonomous VehiclesMotion ForecastingMotion Planning+1

MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems

2026-05-11 · Marco Coscoy, Zewei Zhou, Seth Z. Zhao, Henry Wei 외 arxiv

Vehicle-to-Everything (V2X) communication has emerged as a promising paradigm for autonomous driving, enabling connected agents to share complementary perception information and negotiate with each other to benefit the f…

Autonomous Driving

Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V

2024-04-16 · Peiyuan Zhi, Zhiyuan Zhang, Yu Zhao, Muzhi Han 외

Autonomous robot navigation and manipulation in open environments require reasoning and replanning with closed-loop feedback. In this work, we present COME-robot, the first closed-loop robotic system utilizing the GPT-4V…

Instruction FollowingMultimodal ReasoningRobot NavigationTask Planning

CW-ERM: Improving Autonomous Driving Planning with Closed-loop Weighted Empirical Risk Minimization

2022-10-05 · Eesha Kumar, Yiming Zhang, Stefano Pini, Simon Stent 외

The imitation learning of self-driving vehicle policies through behavioral cloning is often carried out in an open-loop fashion, ignoring the effect of actions to future states. Training such policies purely with Empiric…

Autonomous DrivingImitation Learning