paper-with-me

홈 › Papers

Diff-Unfolding: A Model-Based Score Learning Framework for Inverse Problems

2025-05-16 · Yuanhao Wang, Shirin Shoushtari, Ulugbek S. Kamilov

Diffusion models are extensively used for modeling image priors for inverse problems. We introduce \emph{Diff-Unfolding}, a principled framework for learning posterior score functions of \emph{conditional diffusion models} by explicitly incorporating the physical measurement operator into a modular network architecture. Diff-Unfolding formulates posterior score learning as the training of an unrolled optimization scheme, where the measurement model is decoupled from the learned image prior. This design allows our method to generalize across inverse problems at inference time by simply replacing the forward operator without retraining. We theoretically justify our unrolling approach by showing that the posterior score can be derived from a composite model-based optimization formulation. Extensive experiments on image restoration and accelerated MRI show that Diff-Unfolding achieves state-of-the-art performance, improving PSNR by up to 2 dB and reducing LPIPS by $22.7\%$, while being both compact (47M parameters) and efficient (0.72 seconds per $256 \times 256$ image). An optimized C++/LibTorch implementation further reduces inference time to 0.63 seconds, underscoring the practicality of our approach.

📄 PDF Abstract BibTeX arXiv:2505.11393

Code (0)

등록된 구현이 없습니다.

Tasks

Image Restoration

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Deep unfolding as iterative regularization for imaging inverse problems

2022-11-24 · Zhuo-Xu Cui, Qingyong Zhu, Jing Cheng, Dong Liang

Recently, deep unfolding methods that guide the design of deep neural networks (DNNs) through iterative algorithms have received increasing attention in the field of inverse problems. Unlike general end-to-end DNNs, unfo…

MRI Reconstruction

SGD-Net: Efficient Model-Based Deep Learning with Theoretical Guarantees

2021-01-22 · Jiaming Liu, Yu Sun, Weijie Gan, Xiaojian Xu 외

Deep unfolding networks have recently gained popularity in the context of solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding ne…

Deep Learning

Deep Coupled-Representation Learning for Sparse Linear Inverse Problems with Side Information

2019-07-04 · Evaggelia Tsiligianni, Nikos Deligiannis

In linear inverse problems, the goal is to recover a target signal from undersampled, incomplete or noisy linear measurements. Typically, the recovery relies on complex numerical optimization methods; recent approaches p…

Multimodal Deep LearningRepresentation Learning

Two-Stage is Enough: A Concise Deep Unfolding Reconstruction Network for Flexible Video Compressive Sensing

2022-01-15 · Siming Zheng, Xiaoyu Yang, Xin Yuan

We consider the reconstruction problem of video compressive sensing (VCS) under the deep unfolding/rolling structure. Yet, we aim to build a flexible and concise model using minimum stages. Different from existing deep u…

Compressive SensingDemosaickingVideo Compressive Sensing

Unfolding Framework with Prior of Convolution-Transformer Mixture and Uncertainty Estimation for Video Snapshot Compressive Imaging

2023-06-20 · ICCV 2023 1 · Siming Zheng, Xin Yuan

We consider the problem of video snapshot compressive imaging (SCI), where sequential high-speed frames are modulated by different masks and captured by a single measurement. The underlying principle of reconstructing mu…