paper-with-me

Papers

Latent Visual Cache for Video Reasoning

2026-07-01 · Yongheng Zhang, Zhipeng Xu, Hao Wu, Yinghui Li, Di Yin, Xing Sun, Philip S. Yu arxiv

Video reasoning requires Large Multimodal Models (LMMs) to remain grounded in dense evidence, yet existing systems largely adopt "read-once, generate-many" paradigm, in which visual grounding weakens during generation. This phenomenon has been widely observed and is known as Visual Anchoring Decay. To fill this gap, we introduce Latent Video Cache (Latent-VC), a recurrent latent visual cache inserted into the decoder to preserve compact visual memories throughout reasoning. The cache is trained with supervised contrastive cache alignment and vision-grounded GRPO with a latent grounding reward, while maintaining strict train-inference alignment through native decoder hidden states. Built on Qwen3.5-9B, Latent-VC consistently outperforms strong CoT and SFT+GRPO baselines across six video benchmarks, with especially clear gains on grounding-intensive and long-video tasks. In addition, it also achieves higher accuracy with substantially shorter responses, suggesting that latent visual caching improves video reasoning by preserving visual evidence rather than relying on longer textual chains.

📄 PDF Abstract BibTeX arXiv:2607.02607

Code (0)

등록된 구현이 없습니다.

Tasks

Visual Grounding

Similar Papers 제목 키워드 기반

EchoCache: Energy-Guided Cross-Modal Caching for Efficient Audio-Driven Video Generation

2026-08-03 · Jiayu Chen, Xiaoyu Wu, Rongshan Gao, Maoliang Li 외 arxiv

Audio-driven video generation (A2V) has achieved promising progress in synthesizing temporally coherent and audio-visually aligned videos, yet its inference remains expensive due to the iterative denoising process of dif…

Video Generation

StreamMem: Query-Agnostic KV Cache Memory for Streaming Video Understanding

2025-08-21 · Yanlai Yang, Zhuokai Zhao, Satya Narayan Shukla, Aashu Singh 외 arxiv

Multimodal large language models (MLLMs) have made significant progress in visual-language reasoning, but their ability to efficiently handle long videos remains limited. Despite recent advances in long-context MLLMs, st…

Video Question Answering

Plug-and-Play 1.x-Bit KV Cache Quantization for Video Large Language Models

2025-03-20 · Keda Tao, Haoxuan You, Yang Sui, Can Qin 외

Video large language models (VideoLLMs) have demonstrated the capability to process longer video inputs and enable complex reasoning and analysis. However, due to the thousands of visual tokens from the video frames, key…

Quantization

Sharp Eyes and Memory for VideoLLMs: Information-Aware Visual Token Pruning for Efficient and Reliable VideoLLM Reasoning

2025-11-11 · Jialong Qin, Xin Zou, Di Lu, Yibo Yan 외 arxiv

Current Video Large Language Models (VideoLLMs) suffer from quadratic computational complexity and key-value cache scaling, due to their reliance on processing excessive redundant visual tokens. To address this problem, …

CHAI: CacHe Attention Inference for text2video

2026-02-18 · Joel Mathew Cherian, Ashutosh Muralidhara Bharadwaj, Vima Gupta, Anand Padmanabha Iyer arxiv

Text-to-video diffusion models deliver impressive results but remain slow because of the sequential denoising of 3D latents. Existing approaches to speed up inference either require expensive model retraining or use heur…