paper-with-me

홈 › Papers

SToRe3D: Sparse Token Relevance in ViTs for Efficient Multi-View 3D Object Detection

2026-05-13 · Sandro Papais, Lezhou Feng, Charles Cossette, Lingting Ge arxiv

Vision Transformers (ViTs) enable strong multi-view 3D detection but are limited by high inference latency from dense token and query processing across multiple views and large 3D regions. Existing sparsity methods, designed mainly for 2D vision, prune or merge image tokens but do not extend to full-model sparsity or address 3D object queries. We introduce SToRe3D, a relevance-aligned sparsity framework that jointly selects 2D image tokens and 3D object queries while storing filtered features for reactivation. Mutual 2D-3D relevance heads allocate compute to driving-critical content and preserve other embeddings. Evaluated on nuScenes and our new nuScenes-Relevance benchmark, SToRe3D achieves up to 3x faster inference with marginal accuracy loss, establishing real-time large-scale ViT-based 3D detection while maintaining accuracy on planning-critical agents.

📄 PDF Abstract BibTeX arXiv:2605.14110

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object Detection

Similar Papers 제목 키워드 기반

SPOT: Sparsification with Attention Dynamics via Token Relevance in Vision Transformers

2025-11-13 · Oded Schlesinger, Amirhossein Farzam, J. Matias Di Martino, Guillermo Sapiro arxiv

While Vision Transformers (ViT) have demonstrated remarkable performance across diverse tasks, their computational demands are substantial, scaling quadratically with the number of processed tokens. Compact attention rep…

Computational Efficiency

Bridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasets

2022-10-12 · Zhiying Lu, Hongtao Xie, Chuanbin Liu, Yongdong Zhang

There still remains an extreme performance gap between Vision Transformers (ViTs) and Convolutional Neural Networks (CNNs) when training from scratch on small datasets, which is concluded to the lack of inductive bias. I…

Inductive Bias

AViTS: Adaptive Spatiotemporal Token Selection for Efficient Dynamic-Resolution Generation

2026-08-18 · Haoran Qin, Zhengan Yan, Shikang Zheng, Xiaobing Tu 외 arxiv

Diffusion Transformers (DiTs) achieve high-quality generation but are costly due to iterative sampling. Dynamic-resolution sampling reduces early-stage cost by denoising at low resolution; however, uniformly upsampling a…

Self-Slimming Vision Transformer

2021-09-29 · Zhuofan Zong, Kunchang Li, Guanglu Song, Yali Wang 외

Vision transformers (ViTs) have become the popular structures and outperformed convolutional neural networks (CNNs) on various vision tasks. However, such powerful transformers bring huge computation burden, due to the e…

Knowledge Distillation

On Improving Adversarial Transferability of Vision Transformers

2021-06-08 · ICLR 2022 4 · Muzammal Naseer, Kanchana Ranasinghe, Salman Khan, Fahad Shahbaz Khan 외

Vision transformers (ViTs) process input images as sequences of patches via self-attention; a radically different architecture than convolutional neural networks (CNNs). This makes it interesting to study the adversarial…

Adversarial Attack