paper-with-me

홈 › Papers

StreamCacheVGGT: Streaming Visual Geometry Transformers with Robust Scoring and Hybrid Cache Compression

2026-04-16 · Xuanyi Liu, Chunan Yu, Deyi Ji, Qi Zhu, Lingyun Sun, Xuanfu Li, Jin Ma, Tianrun Chen, Lanyun Zhu arxiv

Reconstructing dense 3D geometry from continuous video streams requires stable inference under a constant memory budget. Existing $O(1)$ frameworks primarily rely on a ``pure eviction'' paradigm, which suffers from significant information destruction due to binary token deletion and evaluation noise from localized, single-layer scoring. To address these bottlenecks, we propose StreamCacheVGGT, a training-free framework that reimagines cache management through two synergistic modules: Cross-Layer Consistency-Enhanced Scoring (CLCES) and Hybrid Cache Compression (HCC). CLCES mitigates activation noise by tracking token importance trajectories across the Transformer hierarchy, employing order-statistical analysis to identify sustained geometric salience. Leveraging these robust scores, HCC transcends simple eviction by introducing a three-tier triage strategy that merges moderately important tokens into retained anchors via nearest-neighbor assignment on the key-vector manifold. This approach preserves essential geometric context that would otherwise be lost. Extensive evaluations on five benchmarks (7-Scenes, NRGBD, ETH3D, Bonn, and KITTI) demonstrate that StreamCacheVGGT sets a new state-of-the-art, delivering superior reconstruction accuracy and long-term stability while strictly adhering to constant-cost constraints.

📄 PDF Abstract BibTeX arXiv:2604.15237

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

FrameVGGT: Coherence-Preserving Memory for Bounded Streaming Geometry

2026-03-08 · Zhisong Xu, Takeshi Oishi arxiv

Streaming Visual Geometry Transformers such as StreamVGGT enable strong online 3D perception, but their KV-cache grows unbounded over long streams, limiting practical deployment. We study bounded-memory streaming geometr…

Camera Pose Estimation3D ReconstructionDepth Estimation

Evict3R: Training-Free Token Eviction for Memory-Bounded Streaming Visual Geometry Transformers

2025-09-22 · Soroush Mahdi, Fardin Ayar, Ehsan Javanmardi, Manabu Tsukada 외 arxiv

Streaming visual transformers like StreamVGGT achieve strong 3D perception but suffer from unbounded growth of key value (KV) memory, which limits scalability. We propose a training-free, inference-time token eviction po…

Camera Pose Estimation3D ReconstructionDepth Estimation

LongStream: Long-Sequence Streaming Autoregressive Visual Geometry

2026-02-13 · Chong Cheng, Xianda Chen, Tao Xie, Wei Yin 외 arxiv

Long-sequence streaming 3D reconstruction remains a significant open challenge. Existing autoregressive models often fail when processing long sequences because they anchor poses to the first frame, leading to attention …

3D Reconstruction

XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression

2026-01-03 · Zunhai Su, Weihao Ye, Hansen Feng, Keyu Fan 외 arxiv

Learning-based 3D visual geometry models have benefited substantially from large-scale transformers. Among these, StreamVGGT leverages frame-wise causal attention for strong streaming reconstruction, but suffers from unb…

CoRDS: Coreset-based Representative and Diverse Selection for Streaming Video Understanding

2026-05-14 · Ailar Mahdizadeh, Puria Azadi, Muchen Li, Xiangteng He 외 arxiv

Streaming video understanding with large vision-language models (VLMs) requires a compact memory that can support future reasoning over an ever-growing visual history. A common solution is to compress the key-value (KV) …