paper-with-me

홈 › Papers

FRAG: Frequency Adapting Group for Diffusion Video Editing

2024-06-10 · Sunjae Yoon, Gwanhyeong Koo, Geonwoo Kim, Chang D. Yoo

In video editing, the hallmark of a quality edit lies in its consistent and unobtrusive adjustment. Modification, when integrated, must be smooth and subtle, preserving the natural flow and aligning seamlessly with the original vision. Therefore, our primary focus is on overcoming the current challenges in high quality edit to ensure that each edit enhances the final product without disrupting its intended essence. However, quality deterioration such as blurring and flickering is routinely observed in recent diffusion video editing systems. We confirm that this deterioration often stems from high-frequency leak: the diffusion model fails to accurately synthesize high-frequency components during denoising process. To this end, we devise Frequency Adapting Group (FRAG) which enhances the video quality in terms of consistency and fidelity by introducing a novel receptive field branch to preserve high-frequency components during the denoising process. FRAG is performed in a model-agnostic manner without additional training and validates the effectiveness on video editing benchmarks (i.e., TGVE, DAVIS).

📄 PDF Abstract BibTeX arXiv:2406.06044

Code (1)

dbstjswo505/FRAG 공식 구현 pytorch

Tasks

DenoisingVideo Editing

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

FADE: Frequency-Aware Diffusion Model Factorization for Video Editing

2025-06-06 · CVPR 2025 1 · Yixuan Zhu, Haolin Wang, Shilin Ma, Wenliang Zhao 외

Recent advancements in diffusion frameworks have significantly enhanced video editing, achieving high fidelity and strong alignment with textual prompts. However, conventional approaches using image diffusion models fall…

Video Editing

Sequential Data Generation with Groupwise Diffusion Process

2023-10-02 · Sangyun Lee, Gayoung Lee, Hyunsu Kim, Junho Kim 외

We present the Groupwise Diffusion Model (GDM), which divides data into multiple groups and diffuses one group at one time interval in the forward diffusion process. GDM generates data sequentially from one group at one …

Disentanglement

Rethinking Video Deblurring with Wavelet-Aware Dynamic Transformer and Diffusion Model

2024-08-24 · Chen Rao, Guangyuan Li, Zehua Lan, Jiakai Sun 외

Current video deblurring methods have limitations in recovering high-frequency information since the regression losses are conservative with high-frequency details. Since Diffusion Models (DMs) have strong capabilities i…

DeblurringVideo Deblurring

WF-VAE: Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Model

2024-11-26 · CVPR 2025 1 · Zongjian Li, Bin Lin, Yang Ye, Liuhan Chen 외

Video Variational Autoencoder (VAE) encodes videos into a low-dimensional latent space, becoming a key component of most Latent Video Diffusion Models (LVDMs) to reduce model training costs. However, as the resolution an…

FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attention

2024-07-29 · Yu Lu, Yuanzhi Liang, Linchao Zhu, Yi Yang

Video diffusion models have made substantial progress in various video generation applications. However, training models for long video generation tasks require significant computational and data resources, posing a chal…

DenoisingVideo Generation