paper-with-me

Papers

Diffusion Priors for Variational Likelihood Estimation and Image Denoising

2024-10-23 · Jun Cheng, Shan Tan

Real-world noise removal is crucial in low-level computer vision. Due to the remarkable generation capabilities of diffusion models, recent attention has shifted towards leveraging diffusion priors for image restoration tasks. However, existing diffusion priors-based methods either consider simple noise types or rely on approximate posterior estimation, limiting their effectiveness in addressing structured and signal-dependent noise commonly found in real-world images. In this paper, we build upon diffusion priors and propose adaptive likelihood estimation and MAP inference during the reverse diffusion process to tackle real-world noise. We introduce an independent, non-identically distributed likelihood combined with the noise precision (inverse variance) prior and dynamically infer the precision posterior using variational Bayes during the generation process. Meanwhile, we rectify the estimated noise variance through local Gaussian convolution. The final denoised image is obtained by propagating intermediate MAP solutions that balance the updated likelihood and diffusion prior. Additionally, we explore the local diffusion prior inherent in low-resolution diffusion models, enabling direct handling of high-resolution noisy images. Extensive experiments and analyses on diverse real-world datasets demonstrate the effectiveness of our method. Code is available at https://github.com/HUST-Tan/DiffusionVI.

📄 PDF Abstract BibTeX arXiv:2410.17521

Code (1)

hust-tan/diffusionvi 공식 구현 pytorch

Tasks

DenoisingImage DenoisingImage Restoration

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Riemannian Diffusion Models

2022-08-16 · Chin-wei Huang, Milad Aghajohari, Avishek Joey Bose, Prakash Panangaden 외

Diffusion models are recent state-of-the-art methods for image generation and likelihood estimation. In this work, we generalize continuous-time diffusion models to arbitrary Riemannian manifolds and derive a variational…

Image Generation

Diffusion Priors In Variational Autoencoders

2021-06-29 · ICML Workshop INNF 2021 7 · Antoine Wehenkel, Gilles Louppe

Among likelihood-based approaches for deep generative modelling, variational autoencoders (VAEs) offer scalable amortized posterior inference and fast sampling. However, VAEs are also more and more outperformed by compet…

Denoising

Variational Bayesian Imaging with an Efficient Surrogate Score-based Prior

2023-09-05 · Berthy T. Feng, Katherine L. Bouman

We propose a surrogate function for efficient yet principled use of score-based priors in Bayesian imaging. We consider ill-posed inverse imaging problems in which one aims for a clean image posterior given incomplete or…

Variational Inference

Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs

2023-05-06 · Kaiwen Zheng, Cheng Lu, Jianfei Chen, Jun Zhu

Diffusion models have exhibited excellent performance in various domains. The probability flow ordinary differential equation (ODE) of diffusion models (i.e., diffusion ODEs) is a particular case of continuous normalizin…

Density EstimationImage Generation

Score-based diffusion priors for multi-target detection

2023-12-13 · Alon Zabatani, Shay Kreymer, Tamir Bendory

Multi-target detection (MTD) is the problem of estimating an image from a large, noisy measurement that contains randomly translated and rotated copies of the image. Motivated by the single-particle cryo-electron microsc…