paper-with-me

Papers

Inverse Problems with Diffusion Models: A MAP Estimation Perspective

2024-07-27 · Sai Bharath Chandra Gutha, Ricardo Vinuesa, Hossein Azizpour

Inverse problems have many applications in science and engineering. In Computer vision, several image restoration tasks such as inpainting, deblurring, and super-resolution can be formally modeled as inverse problems. Recently, methods have been developed for solving inverse problems that only leverage a pre-trained unconditional diffusion model and do not require additional task-specific training. In such methods, however, the inherent intractability of determining the conditional score function during the reverse diffusion process poses a real challenge, leaving the methods to settle with an approximation instead, which affects their performance in practice. Here, we propose a MAP estimation framework to model the reverse conditional generation process of a continuous time diffusion model as an optimization process of the underlying MAP objective, whose gradient term is tractable. In theory, the proposed framework can be applied to solve general inverse problems using gradient-based optimization methods. However, given the highly non-convex nature of the loss objective, finding a perfect gradient-based optimization algorithm can be quite challenging, nevertheless, our framework offers several potential research directions. We use our proposed formulation to develop empirically effective algorithms for image restoration. We validate our proposed algorithms with extensive experiments over multiple datasets across several restoration tasks.

📄 PDF Abstract BibTeX arXiv:2407.20784

Code (1)

guthasaibharathchandra/MAP-GA 공식 구현 pytorch

Tasks

DeblurringImage InpaintingImage RestorationSuper-Resolution

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

Inverse problems with diffusion models: MAP estimation via mode-seeking loss

2025-12-11 · Sai Bharath Chandra Gutha, Ricardo Vinuesa, Hossein Azizpour arxiv

A pre-trained unconditional diffusion model, combined with posterior sampling or maximum a posteriori (MAP) estimation techniques, can solve arbitrary inverse problems without task-specific training or fine-tuning. Howev…

Local MAP Sampling for Diffusion Models

2025-10-07 · Shaorong Zhang, Rob Brekelmans, Greg Ver Steeg arxiv

Diffusion Posterior Sampling (DPS) provides a principled Bayesian approach to inverse problems by sampling from $p(x_0 \mid y)$. While posterior sampling is valuable for capturing uncertainty and multi-modality, many cla…

Image Restoration

Warped Diffusion: Solving Video Inverse Problems with Image Diffusion Models

2024-10-21 · Giannis Daras, Weili Nie, Karsten Kreis, Alex Dimakis 외

Using image models naively for solving inverse video problems often suffers from flickering, texture-sticking, and temporal inconsistency in generated videos. To tackle these problems, in this paper, we view frames as co…

Super-ResolutionVideo InpaintingVideo Super-Resolution

A Variational Perspective on Solving Inverse Problems with Diffusion Models

2023-05-07 · Morteza Mardani, Jiaming Song, Jan Kautz, Arash Vahdat

Diffusion models have emerged as a key pillar of foundation models in visual domains. One of their critical applications is to universally solve different downstream inverse tasks via a single diffusion prior without re-…

DenoisingImage RestorationStochastic Optimization

Unleashing the Denoising Capability of Diffusion Prior for Solving Inverse Problems

2024-06-11 · Jiawei Zhang, Jiaxin Zhuang, Cheng Jin, Gen Li 외

The recent emergence of diffusion models has significantly advanced the precision of learnable priors, presenting innovative avenues for addressing inverse problems. Since inverse problems inherently entail maximum a pos…

DenoisingImage Restoration