paper-with-me

Papers

PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory

2026-06-15 · Shuai Yang, Bingjie Gao, Ziwei Liu, Jiaqi Wang, Dahua Lin, Tong Wu arxiv

Consistent video generation under editing operations requires persistence: when edits modify scene appearance or layout, subsequent generations should remain coherent across time and viewpoints. However, existing memory designs struggle to maintain long-term consistency after such modifications, as stored contexts may become outdated or invalid. To address this, we propose PermaVid, a novel framework built upon a multi-modal context memory that disentangles spatial context into semantic appearance and geometric structure, together with an edit-aware memory update and retrieval strategy that keeps memory evolution aligned with subsequent observations. Specifically, we develop two complementary memory banks: an RGB context memory that captures appearance-aware observations while implicitly encoding geometry, and a depth context memory that preserves geometry-only structure disentangled from semantics. Building on this design, we introduce a memory-guided video generation model that performs multi-modal feature fusion under reference conditions drawn from mixed-modality memory contexts. Experiments demonstrate that our method maintains strong long-term semantic and structural consistency after edits, significantly outperforming state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2606.16449

Code (0)

등록된 구현이 없습니다.

Tasks

Video Generation

Similar Papers 제목 키워드 기반

I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models

2024-05-26 · Wenqi Ouyang, Yi Dong, Lei Yang, Jianlou Si 외

The remarkable generative capabilities of diffusion models have motivated extensive research in both image and video editing. Compared to video editing which faces additional challenges in the time dimension, image editi…

Video Editing

Geometry-Instructed Video Editing

2026-06-23 · Chirui Chang, Xiaoyang Lyu, Yi-Hua Huang, Haoru Tan 외 arxiv

Object-level geometric edits, including translating, rotating, scaling, duplicating, or removing an object, are routine operations in digital content creation (DCC) workflows, yet they remain unreliable in generative vid…

FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesis

2023-12-29 · CVPR 2024 1 · Feng Liang, Bichen Wu, Jialiang Wang, Licheng Yu 외

Diffusion models have transformed the image-to-image (I2I) synthesis and are now permeating into videos. However, the advancement of video-to-video (V2V) synthesis has been hampered by the challenge of maintaining tempor…

Optical Flow EstimationVideo-to-Video Synthesis

We'll Fix it in Post: Improving Text-to-Video Generation with Neuro-Symbolic Feedback

2025-04-24 · Minkyu Choi, S P Sharan, Harsh Goel, Sahil Shah 외

Current text-to-video (T2V) generation models are increasingly popular due to their ability to produce coherent videos from textual prompts. However, these models often struggle to generate semantically and temporally co…

Text-to-Video GenerationVideo Generation

Memory-V2V: Memory-Augmented Video-to-Video Diffusion for Consistent Multi-Turn Editing

2026-01-22 · Dohun Lee, Chun-Hao Paul Huang, Xuelin Chen, Jong Chul Ye 외 arxiv

Video-to-video diffusion models achieve impressive single-turn editing performance, but practical editing workflows are inherently iterative. When edits are applied sequentially, existing models treat each turn independe…

Novel View Synthesis