paper-with-me

Papers

VideoMemory: Toward Consistent Video Generation via Memory Integration

2026-01-07 · Jinsong Zhou, Yihua Du, Xinli Xu, Luozhou Wang, Zijie Zhuang, Yehang Zhang, Shuaibo Li, Xiaojun Hu, Bolan Su, Ying-cong Chen arxiv

Maintaining consistent characters, props, and environments across multiple shots is a central challenge in narrative video generation. Existing models can produce high-quality short clips but often fail to preserve entity identity and appearance when scenes change or when entities reappear after long temporal gaps. We present VideoMemory, an entity-centric framework that integrates narrative planning with visual generation through a Dynamic Memory Bank. Given a structured script, a multi-agent system decomposes the narrative into shots, retrieves entity representations from memory, and synthesizes keyframes and videos conditioned on these retrieved states. The Dynamic Memory Bank stores explicit visual and semantic descriptors for characters, props, and backgrounds, and is updated after each shot to reflect story-driven changes while preserving identity. This retrieval-update mechanism enables consistent portrayal of entities across distant shots and supports coherent long-form generation. To evaluate this setting, we construct a 54-case multi-shot consistency benchmark covering character-, prop-, and background-persistent scenarios. Extensive experiments show that VideoMemory achieves strong entity-level coherence and high perceptual quality across diverse narrative sequences.

📄 PDF Abstract BibTeX arXiv:2601.03655

Code (0)

등록된 구현이 없습니다.

Tasks

Video Generation

Similar Papers 제목 키워드 기반

TeleWorld: Towards Dynamic Multimodal Synthesis with a 4D World Model

2025-12-31 · Yabo Chen, Yuanzhi Liang, Jiepeng Wang, Tingxi Chen 외 arxiv

World models aim to endow AI systems with the ability to represent, generate, and interact with dynamic environments in a coherent and temporally consistent manner. While recent video generation models have demonstrated …

multimodal generationVideo Generation

Shallow Features Matter: Hierarchical Memory with Heterogeneous Interaction for Unsupervised Video Object Segmentation

2025-07-30 · Zheng Xiangyu, He Songcheng, Li Wanyun, Li Xiaoqiang 외 arxiv

Unsupervised Video Object Segmentation (UVOS) aims to predict pixel-level masks for the most salient objects in videos without any prior annotations. While memory mechanisms have been proven critical in various video seg…

Unsupervised Video Object SegmentationVideo Saliency DetectionVideo Segmentation

PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory

2026-06-15 · Shuai Yang, Bingjie Gao, Ziwei Liu, Jiaqi Wang 외 arxiv

Consistent video generation under editing operations requires persistence: when edits modify scene appearance or layout, subsequent generations should remain coherent across time and viewpoints. However, existing memory …

Video Generation

WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories

2026-03-02 · Yisu Zhang, Chenjie Cao, Tengfei Wang, Xuhui Zuo 외 arxiv

Recent advances in foundational Video Diffusion Models (VDMs) have yielded significant progress. Yet, despite the remarkable visual quality of generated videos, reconstructing consistent 3D scenes from these outputs rema…

3D ReconstructionScene GenerationVideo GenerationPoint Clouds

Quant VideoGen: Auto-Regressive Long Video Generation via 2-Bit KV-Cache Quantization

2026-02-03 · Haocheng Xi, Shuo Yang, Yilong Zhao, Muyang Li 외 arxiv

Despite rapid progress in autoregressive video diffusion, an emerging system algorithm bottleneck limits both deployability and generation capability: KV cache memory. In autoregressive video generation models, the KV ca…

Video Generation