paper-with-me

홈 › Papers

ReCA: Multi-Shot Long Video Extrapolation via Recursive Context Allocation

2026-05-26 · Akide Liu, Jinbo Xing, Chaojie Mao, Ye Li, Zeyu Zhang, Yefei He, Weijie Wang, Zihan Wang, Yu Liu, Gholamreza Haffari, Bohan Zhuang arxiv

Minute-scale cinematic video generation is a central challenge for generative video models. Existing paradigms address only fragments of this challenge: single-shot extrapolation preserves an anchor but lacks cinematic structure, while multi-shot storytelling imposes structure yet remains free to invent its visual states rather than continue an observed one. We define Multi-Shot Video Extrapolation (MSVE), a task that extends an observed frame or clip into a sequence of cinematically structured shots while preserving anchor state and advancing narrative intent. This setting operates under the finite per-call generation budget of short-video models. We identify three coupled bottlenecks: (1) global planners over-specify unsupported details from full screenplays; (2) shot-level prompts dilute task-relevant state when carrying the complete story; and (3) temporal chaining turns generated frames into a lossy memory in which identity, scene, object, and action state decay. MSVE reveals that long-video failure is not merely a limitation of context length, but a failure of context allocation. We propose Recursive Context Allocation (ReCA), an inference-time framework that allocates context hierarchically across planning and generation. ReCA recursively decomposes MSVE into context-bounded subproblems, invokes frozen generators at leaf nodes, and propagates structured state updates across time. To evaluate this setting, we further propose MSVE-Bench and NB-Q, a source-grounded protocol with prompts purpose-built for 3 to 5 minute long-video generation, a regime not addressed by existing short-clip benchmarks. Compared to previous methods, ReCA improves average normalized score by 8 to 16 percent over the strongest competing controller and improves multi-shot consistency metrics by 28 to 43 percent. View the project page at https://reca.vmv.re.

📄 PDF Abstract BibTeX arXiv:2605.26525

Code (0)

등록된 구현이 없습니다.

Tasks

Video Generation

Similar Papers 제목 키워드 기반

Prompt-Adapter Context Routing for Parameter-Efficient Multi-Shot Long Video Extrapolation

2026-07-07 · Anna Córdoba, Adam Puente Tercero, Nerea Angulo Hijo, Mar Linares Tercero 외 arxiv

We present PACR-Video, a parameter-efficient framework for multi-shot long video extrapolation that preserves recurring entities, scene structure, visual style, and causal progression without full generator fine-tuning. …

"Previously on ..." From Recaps to Story Summarization

2024-05-19 · Aditya Kumar Singh, Dhruv Srivastava, Makarand Tapaswi

We introduce multimodal story summarization by leveraging TV episode recaps - short video sequences interweaving key story moments from previous episodes to bring viewers up to speed. We propose PlotSnap, a dataset featu…

Video Summarization

Previously on ... From Recaps to Story Summarization

2024-01-01 · CVPR 2024 1 · Aditya Kumar Singh, Dhruv Srivastava, Makarand Tapaswi

We introduce multimodal story summarization by leveraging TV episode recaps - short video sequences interweaving key story moments from previous episodes to bring viewers up to speed. We propose PlotSnap a dataset fe…

Video Summarization

RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers

2025-02-21 · Min Zhao, Guande He, Yixiao Chen, Hongzhou Zhu 외

Recent advancements in video generation have enabled models to synthesize high-quality, minute-long videos. However, generating even longer videos with temporal coherence remains a major challenge, and existing length ex…

Video Generation

Fast Kernel Learning for Multidimensional Pattern Extrapolation

2014-12-01 · NeurIPS 2014 12 · Andrew G. Wilson, Elad Gilboa, Arye Nehorai, John P. Cunningham

The ability to automatically discover patterns and perform extrapolation is an essential quality of intelligent systems. Kernel methods, such as Gaussian processes, have great potential for pattern extrapolation, since t…

Gaussian Processes