paper-with-me

홈 › Papers

Adaptive-WAM: Quality-Guided Early-Exit Planning from Intermediate Video-Diffusion Features

2026-08-06 · Sining Ang, Yuguang Yang, Yan Wang arxiv

Large video diffusion models provide rich spatiotemporal priors for autonomous driving, but existing world-action models often inherit the cost of iterative future-video generation even though deployment only requires an ego trajectory. We ask a more basic question: how much of a video diffusion model must be executed to make a reliable driving decision? Through a controlled study of video denoising timesteps and Diffusion Transformer (DiT) depth, we find that planning performance is largely insensitive to the tested video-noise levels, whereas strong trajectories can already be decoded from intermediate layers. Based on this observation, we introduce Adaptive-WAM, a quality-aware multi-exit planner built on a Wan2.2-5B backbone. Trajectory diffusion heads are attached to selected DiT blocks, and a lightweight trajectory-quality scorer terminates inference once the best trajectory decoded so far satisfies a quality threshold; otherwise, computation continues from the cached hidden state to a deeper exit. The deployed planner therefore avoids the iterative classifier-free denoising loop and VAE decoding required for future-video synthesis, while dynamically allocating backbone depth according to trajectory quality. On NAVSIM, the adaptive single-trajectory planner achieves 90.8 PDMS; a separate fixed-exit variant reaches 92.6 PDMS with 64 proposals. It further obtains 89.9 EPDMS on NAVSIM v2, yielding the best reported results among the compared front-view video world-model planners. Without target-domain fine-tuning, Adaptive-WAM transfers to nuScenes with 0.88 m average L2 error and a 0.08\% collision rate. On an A100, adaptive routing improves PDMS from 90.62 to 90.79 while averaging 170 ms end-to-end planning latency, approximately 10\% below the 190 ms fixed block-15 planner and 47\% below the 320 ms fixed full-depth planner. Code will be released.

📄 PDF Abstract BibTeX arXiv:2608.06008

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingVideo GenerationVideo Denoising

Similar Papers 제목 키워드 기반

DeeAD: Dynamic Early Exit of Vision-Language Action for Efficient Autonomous Driving

2025-11-25 · Haibo HU, Lianming Huang, Nan Guan, Chun Jason Xue arxiv

Vision-Language Action (VLA) models unify perception, reasoning, and trajectory generation for autonomous driving, but suffer from significant inference latency due to deep transformer stacks. We present DeeAD, a trainin…

Autonomous Driving

Top-Down Semantic Refinement for Image Captioning

2025-10-25 · Jusheng Zhang, Kaitong Cai, Jing Yang, Jian Wang 외 arxiv

Large Vision-Language Models (VLMs) face an inherent contradiction in image captioning: their powerful single-step generation capabilities often lead to a myopic decision-making process. This makes it difficult to mainta…

Image Captioning

When Do Early-Exit Networks Generalize? A PAC-Bayesian Theory of Adaptive Depth

2026-04-17 · Dongxin Guo, Jikun Wu, Siu Ming Yiu arxiv

Early-exit neural networks enable adaptive computation by allowing confident predictions to exit at intermediate layers, achieving 2-8$\times$ inference speedup. Despite widespread deployment, their generalization proper…

Planning-Augmented Sampling with Early Guidance for High-Reward Discovery

2025-10-01 · Rui Zhu, Yudong Zhang, Xuan Yu, Chen Zhang 외 arxiv

Generative Flow Networks (GFlowNets) enable structured generation with inherent diversity, but existing sampling strategies often rely on weak guided exploration, slowing early discovery of high-reward candidates. In tas…

A Machine-to-Machine Knowledge-Guided LLM Agent for Generalizable Radiotherapy Treatment Planning

2026-05-30 · Md Mainul Abrar, Xun Jia, Yujie Chi arxiv

In this work, we propose a prototype machine-to-machine (M2M) knowledge-guided Large Language Model (LLM) framework for automated radiotherapy treatment planning. In the proposed paradigm, Treatment Planning Parameter (T…

Reinforcement LearningPhysical Intuition