paper-with-me

홈 › Papers

ST-Prune: Training-Free Spatio-Temporal Token Pruning for Vision-Language Models in Autonomous Driving

2026-04-21 · Lin Sha, Haiyun Guo, Tao Wang, Cong Zhang, Min Huang, Jinqiao Wang, Qinghai Miao arxiv

Vision-Language Models (VLMs) have become central to autonomous driving systems, yet their deployment is severely bottlenecked by the massive computational overhead of multi-view camera and multi-frame video input. Existing token pruning methods, primarily designed for single-image inputs, treat each frame or view in isolation and thus fail to exploit the inherent spatio-temporal redundancies in driving scenarios. To bridge this gap, we propose ST-Prune, a training-free, plug-and-play framework comprising two complementary modules: Motion-aware Temporal Pruning (MTP) and Ring-view Spatial Pruning (RSP). MTP addresses temporal redundancy by encoding motion volatility and temporal recency as soft constraints within the diversity selection objective, prioritizing dynamic trajectories and current-frame content over static historical background. RSP further resolves spatial redundancy by exploiting the ring-view camera geometry to penalize bilateral cross-view similarity, eliminating duplicate projections and residual background that temporal pruning alone cannot suppress. These two modules together constitute a complete spatio-temporal pruning process, preserving key scene information under strict compression. Validated across four benchmarks spanning perception, prediction, and planning, ST-Prune establishes new state-of-the-art for training-free token pruning. Notably, even at 90\% token reduction, ST-Prune achieves near-lossless performance with certain metrics surpassing the full-model baseline, while maintaining inference speeds comparable to existing pruning approaches.

📄 PDF Abstract BibTeX arXiv:2604.19145

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Similar Papers 제목 키워드 기반

EchoPrune: Interpreting Redundancy as Temporal Echoes for Efficient VideoLLMs

2026-05-11 · Jiameng Li, Minye Wu, Jiezhang Cao, Aleksei Tiulpin 외 arxiv

Long-form video understanding remains challenging for Video Large Language Models (VideoLLMs), as the dense frame sampling introduces massive visual tokens while sparse sampling risks missing critical temporal evidence a…

EgoPrune: Efficient Token Pruning for Egomotion Video Reasoning in Embodied Agent

2025-07-21 · Jiaao Li, Kaiyuan Li, Chen Gao, Yong Li 외

Egomotion videos are first-person recordings where the view changes continuously due to the agent's movement. As they serve as the primary visual input for embodied AI agents, making egomotion video reasoning more effici…

Multimodal Reasoning

Prune Spatio-temporal Tokens by Semantic-aware Temporal Accumulation

2023-08-08 · ICCV 2023 1 · Shuangrui Ding, Peisen Zhao, Xiaopeng Zhang, Rui Qian 외

Transformers have become the primary backbone of the computer vision community due to their impressive performance. However, the unfriendly computation cost impedes their potential in the video recognition domain. To opt…

Video Recognition

Token Reduction via Local and Global Contexts Optimization for Efficient Video Large Language Models

2026-03-02 · Jinlong Li, Liyuan Jiang, Haonan Zhang, Nicu Sebe arxiv

Video Large Language Models (VLLMs) demonstrate strong video understanding but suffer from inefficiency due to redundant visual tokens. Existing pruning primary targets intra-frame spatial redundancy or prunes inside the…

Computational Efficiency

Stage-adaptive Token Selection for Efficient Omni-modal LLMs

2026-05-19 · Zijie Xin, Jie Yang, Ruixiang Zhao, Tianyi Wang 외 arxiv

Omni-modal large language models (om-LLMs) achieve unified audio-visual understanding by encoding video and audio into temporally aligned token sequences interleaved at the window level. However, processing these dense n…