paper-with-me

Papers

Diffusion Image Prior

2025-03-27 · Hamadi Chihaoui, Paolo Favaro

Zero-shot image restoration (IR) methods based on pretrained diffusion models have recently achieved significant success. These methods typically require at least a parametric form of the degradation model. However, in real-world scenarios, the degradation may be too complex to define explicitly. To handle this general case, we introduce the Diffusion Image Prior (DIIP). We take inspiration from the Deep Image Prior (DIP)[16], since it can be used to remove artifacts without the need for an explicit degradation model. However, in contrast to DIP, we find that pretrained diffusion models offer a much stronger prior, despite being trained without knowledge from corrupted data. We show that, the optimization process in DIIP first reconstructs a clean version of the image before eventually overfitting to the degraded input, but it does so for a broader range of degradations than DIP. In light of this result, we propose a blind image restoration (IR) method based on early stopping, which does not require prior knowledge of the degradation model. We validate DIIP on various degradation-blind IR tasks, including JPEG artifact removal, waterdrop removal, denoising and super-resolution with state-of-the-art results.

📄 PDF Abstract BibTeX arXiv:2503.21410

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingImage RestorationJPEG Artifact RemovalSuper-Resolution

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Controlled and Conditional Text to Image Generation with Diffusion Prior

2023-02-23 · Pranav Aggarwal, Hareesh Ravi, Naveen Marri, Sachin Kelkar 외

Denoising Diffusion models have shown remarkable performance in generating diverse, high quality images from text. Numerous techniques have been proposed on top of or in alignment with models like Stable Diffusion and Im…

DecoderDenoisingImage GenerationPrompt Engineering+2

Diffusion Priors for Variational Likelihood Estimation and Image Denoising

2024-10-23 · Jun Cheng, Shan Tan

Real-world noise removal is crucial in low-level computer vision. Due to the remarkable generation capabilities of diffusion models, recent attention has shifted towards leveraging diffusion priors for image restoration …

DenoisingImage DenoisingImage Restoration

Fuzzy-Conditioned Diffusion and Diffusion Projection Attention Applied to Facial Image Correction

2023-06-26 · Majed El Helou

Image diffusion has recently shown remarkable performance in image synthesis and implicitly as an image prior. Such a prior has been used with conditioning to solve the inpainting problem, but only supporting binary user…

Image Generation

PRedItOR: Text Guided Image Editing with Diffusion Prior

2023-02-15 · Hareesh Ravi, Sachin Kelkar, Midhun Harikumar, Ajinkya Kale

Diffusion models have shown remarkable capabilities in generating high quality and creative images conditioned on text. An interesting application of such models is structure preserving text guided image editing. Existin…

Decodertext-guided-image-editing

DiffusionBlend: Learning 3D Image Prior through Position-aware Diffusion Score Blending for 3D Computed Tomography Reconstruction

2024-06-14 · Bowen Song, Jason Hu, ZhaoXu Luo, Jeffrey A. Fessler 외

Diffusion models face significant challenges when employed for large-scale medical image reconstruction in real practice such as 3D Computed Tomography (CT). Due to the demanding memory, time, and data requirements, it i…

Computational EfficiencyComputed Tomography (CT)CT ReconstructionImage Reconstruction+1