Deep Data Consistency: a Fast and Robust Diffusion Model-based Solver for Inverse Problems

2024-05-17 · HanYu Chen, Zhixiu Hao, Liying Xiao

Diffusion models have become a successful approach for solving various image inverse problems by providing a powerful diffusion prior. Many studies tried to combine the measurement into diffusion by score function replacement, matrix decomposition, or optimization algorithms, but it is hard to balance the data consistency and realness. The slow sampling speed is also a main obstacle to its wide application. To address the challenges, we propose Deep Data Consistency (DDC) to update the data consistency step with a deep learning model when solving inverse problems with diffusion models. By analyzing existing methods, the variational bound training objective is used to maximize the conditional posterior and reduce its impact on the diffusion process. In comparison with state-of-the-art methods in linear and non-linear tasks, DDC demonstrates its outstanding performance of both similarity and realness metrics in generating high-quality solutions with only 5 inference steps in 0.77 seconds on average. In addition, the robustness of DDC is well illustrated in the experiments across datasets, with large noise and the capacity to solve multiple tasks in only one pre-trained model.

📄 PDF Abstract BibTeX arXiv:2405.10748

Code (1)

hanyu-chen373/deepdataconsistency 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restoration

2025-10-01 · Alessio Spagnoletti, Andrés Almansa, Marcelo Pereyra arxiv

Computational imaging methods increasingly rely on powerful generative diffusion models to tackle challenging image restoration tasks. In particular, state-of-the-art zero-shot image inverse solvers leverage distilled te…

Computational Efficiency Video Reconstruction Video Restoration Image Restoration

Sparse Scheduled Diffusion Guidance for Inverse Problems

2026-03-09 · Abduragim Shtanchaev, Albina Ilina, Yazid Janati, Arip Asadulaev 외 arxiv

Pretrained diffusion models are effective priors for Bayesian inverse problems, but posterior sampling with these priors is often costly because data-consistency guidance is applied throughout the full reverse trajectory…

Diffusion Posterior Sampling for General Noisy Inverse Problems

2022-09-29 · Hyungjin Chung, Jeongsol Kim, Michael T. McCann, Marc L. Klasky 외

Diffusion models have been recently studied as powerful generative inverse problem solvers, owing to their high quality reconstructions and the ease of combining existing iterative solvers. However, most works focus on s…

Deblurring Retrieval

Beyond Accuracy: Evaluating Posterior Fidelity of Diffusion Inverse Solvers

2026-02-04 · Xiaoyu Qiu, Taewon Yang, Zhanhao Liu, Guanyang Wang 외 arxiv

Uncertainty evaluation is critical in scientific and engineering inverse problems. However, existing benchmarks on Diffusion Inverse Solvers (DIS) primarily focus on reconstruction accuracy but overlook uncertainty and d…

Injecting Measurement Information Yields a Fast and Noise-Robust Diffusion-Based Inverse Problem Solver

2025-08-05 · Jonathan Patsenker, Henry Li, Myeongseob Ko, Ruoxi Jia 외 arxiv

Diffusion models have been firmly established as principled zero-shot solvers for linear and nonlinear inverse problems, owing to their powerful image prior and iterative sampling algorithm. These approaches often rely o…