paper-with-me

Papers

Enhancing and Accelerating Diffusion-Based Inverse Problem Solving through Measurements Optimization

2024-12-05 · Tianyu Chen, Zhendong Wang, Mingyuan Zhou

Diffusion models have recently demonstrated notable success in solving inverse problems. However, current diffusion model-based solutions typically require a large number of function evaluations (NFEs) to generate high-quality images conditioned on measurements, as they incorporate only limited information at each step. To accelerate the diffusion-based inverse problem-solving process, we introduce \textbf{M}easurements \textbf{O}ptimization (MO), a more efficient plug-and-play module for integrating measurement information at each step of the inverse problem-solving process. This method is comprehensively evaluated across eight diverse linear and nonlinear tasks on the FFHQ and ImageNet datasets. By using MO, we establish state-of-the-art (SOTA) performance across multiple tasks, with key advantages: (1) it operates with no more than 100 NFEs, with phase retrieval on ImageNet being the sole exception; (2) it achieves SOTA or near-SOTA results even at low NFE counts; and (3) it can be seamlessly integrated into existing diffusion model-based solutions for inverse problems, such as DPS \cite{chung2022diffusion} and Red-diff \cite{mardani2023variational}. For example, DPS-MO attains a peak signal-to-noise ratio (PSNR) of 28.71 dB on the FFHQ 256 dataset for high dynamic range imaging, setting a new SOTA benchmark with only 100 NFEs, whereas current methods require between 1000 and 4000 NFEs for comparable performance.

📄 PDF Abstract BibTeX arXiv:2412.03941

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

STeP: A General and Scalable Framework for Solving Video Inverse Problems with Spatiotemporal Diffusion Priors

2025-04-10 · Bingliang Zhang, Zihui Wu, Berthy T. Feng, Yang song 외

We study how to solve general Bayesian inverse problems involving videos using diffusion model priors. While it is desirable to use a video diffusion prior to effectively capture complex temporal relationships, due to th…

Regularization by Texts for Latent Diffusion Inverse Solvers

2023-11-27 · Jeongsol Kim, Geon Yeong Park, Hyungjin Chung, Jong Chul Ye

The recent advent of diffusion models has led to significant progress in solving inverse problems, leveraging these models as effective generative priors. Nonetheless, there remain challenges related to the ill-posed nat…

Negation

Accelerating Diffusion Models for Inverse Problems through Shortcut Sampling

2023-05-26 · Gongye Liu, Haoze Sun, Jiayi Li, Fei Yin 외

Diffusion models have recently demonstrated an impressive ability to address inverse problems in an unsupervised manner. While existing methods primarily focus on modifying the posterior sampling process, the potential o…

ColorizationDeblurringSuper-Resolution

Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusion

2023-12-01 · CVPR 2024 1 · Litu Rout, Yujia Chen, Abhishek Kumar, Constantine Caramanis 외

Sampling from the posterior distribution poses a major computational challenge in solving inverse problems using latent diffusion models. Common methods rely on Tweedie's first-order moments, which are known to induce a …

text-guided-image-editing

Latent Refinement via Flow Matching for Training-free Linear Inverse Problem Solving

2025-11-08 · Hossein Askari, Yadan Luo, Hongfu Sun, Fred Roosta arxiv

Recent advances in inverse problem solving have increasingly adopted flow priors over diffusion models due to their ability to construct straight probability paths from noise to data, thereby enhancing efficiency in both…