paper-with-me

홈 › Papers

Deep Equilibrium Diffusion Restoration with Parallel Sampling

2023-11-20 · CVPR 2024 1 · JieZhang Cao, Yue Shi, Kai Zhang, Yulun Zhang, Radu Timofte, Luc van Gool

Diffusion model-based image restoration (IR) aims to use diffusion models to recover high-quality (HQ) images from degraded images, achieving promising performance. Due to the inherent property of diffusion models, most existing methods need long serial sampling chains to restore HQ images step-by-step, resulting in expensive sampling time and high computation costs. Moreover, such long sampling chains hinder understanding the relationship between inputs and restoration results since it is hard to compute the gradients in the whole chains. In this work, we aim to rethink the diffusion model-based IR models through a different perspective, i.e., a deep equilibrium (DEQ) fixed point system, called DeqIR. Specifically, we derive an analytical solution by modeling the entire sampling chain in these IR models as a joint multivariate fixed point system. Based on the analytical solution, we can conduct parallel sampling and restore HQ images without training. Furthermore, we compute fast gradients via DEQ inversion and found that initialization optimization can boost image quality and control the generation direction. Extensive experiments on benchmarks demonstrate the effectiveness of our method on typical IR tasks and real-world settings.

📄 PDF Abstract BibTeX arXiv:2311.11600

Code (1)

caojiezhang/deqir 공식 구현 pytorch

Tasks

Image Restoration

Methods 이 논문이 사용한 방법론

DEQ A new kind of implicit models, where the output of the network is defined as the solution to an "infinite-level" fixed point equation. Thanks to this we can compute the gradient…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Deep Equilibrium Approaches to Diffusion Models

2022-10-23 · Ashwini Pokle, Zhengyang Geng, Zico Kolter

Diffusion-based generative models are extremely effective in generating high-quality images, with generated samples often surpassing the quality of those produced by other models under several metrics. One distinguishing…

Denoising

Enhanced Diffusion Sampling: Efficient Rare Event Sampling and Free Energy Calculation with Diffusion Models

2026-02-18 · Yu Xie, Ludwig Winkler, Lixin Sun, Sarah Lewis 외 arxiv

The rare-event sampling problem has long been the central limiting factor in molecular dynamics (MD), especially in biomolecular simulation. Recently, diffusion models such as BioEmu have emerged as powerful equilibrium …

DGSolver: Diffusion Generalist Solver with Universal Posterior Sampling for Image Restoration

2025-04-30 · Hebaixu Wang, Jing Zhang, HaoNan Guo, Di Wang 외

Diffusion models have achieved remarkable progress in universal image restoration. While existing methods speed up inference by reducing sampling steps, substantial step intervals often introduce cumulative errors. Moreo…

Image RestorationNoise Estimation

Zero-Shot Video Restoration and Enhancement Using Pre-Trained Image Diffusion Model

2024-07-02 · Cong Cao, Huanjing Yue, Xin Liu, Jingyu Yang

Diffusion-based zero-shot image restoration and enhancement models have achieved great success in various tasks of image restoration and enhancement. However, directly applying them to video restoration and enhancement r…

Image RestorationVideo Restoration

VRDMG: Vocal Restoration via Diffusion Posterior Sampling with Multiple Guidance

2023-09-13 · Carlos Hernandez-Olivan, Koichi Saito, Naoki Murata, Chieh-Hsin Lai 외

Restoring degraded music signals is essential to enhance audio quality for downstream music manipulation. Recent diffusion-based music restoration methods have demonstrated impressive performance, and among them, diffusi…

Bandwidth Extension