paper-with-me

Papers

Blind Inverse Problem Solving Made Easy by Text-to-Image Latent Diffusion

2024-11-30 · Michail Dontas, Yutong He, Naoki Murata, Yuki Mitsufuji, J. Zico Kolter, Ruslan Salakhutdinov

Blind inverse problems, where both the target data and forward operator are unknown, are crucial to many computer vision applications. Existing methods often depend on restrictive assumptions such as additional training, operator linearity, or narrow image distributions, thus limiting their generalizability. In this work, we present LADiBI, a training-free framework that uses large-scale text-to-image diffusion models to solve blind inverse problems with minimal assumptions. By leveraging natural language prompts, LADiBI jointly models priors for both the target image and operator, allowing for flexible adaptation across a variety of tasks. Additionally, we propose a novel posterior sampling approach that combines effective operator initialization with iterative refinement, enabling LADiBI to operate without predefined operator forms. Our experiments show that LADiBI is capable of solving a broad range of image restoration tasks, including both linear and nonlinear problems, on diverse target image distributions.

📄 PDF Abstract BibTeX arXiv:2412.00557

Code (0)

등록된 구현이 없습니다.

Tasks

Image Restoration

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Block Coordinate Plug-and-Play Methods for Blind Inverse Problems

2023-05-22 · NeurIPS 2023 11

Plug-and-play (PnP) prior is a well-known class of methods for solving imaging inverse problems by computing fixed-points of operators combining physical measurement models and learned image denoisers. While PnP methods …

Blind Image DeblurringDeblurringImage Deblurring

Blind Inversion using Latent Diffusion Priors

2024-07-01 · Weimin Bai, Siyi Chen, Wenzheng Chen, He Sun

Diffusion models have emerged as powerful tools for solving inverse problems due to their exceptional ability to model complex prior distributions. However, existing methods predominantly assume known forward operators (…

DeblurringImage RestorationInverse Rendering

Plug-and-Play Posterior Sampling for Blind Inverse Problems

2025-05-28 · Anqi Li, Weijie Gan, Ulugbek S. Kamilov

We introduce Blind Plug-and-Play Diffusion Models (Blind-PnPDM) as a novel framework for solving blind inverse problems where both the target image and the measurement operator are unknown. Unlike conventional methods th…

Blind Image DeblurringDeblurringDenoisingImage Deblurring+1

Training Adaptive Reconstruction Networks for Blind Inverse Problems

2022-02-23 · Alban Gossard, Pierre Weiss

Neural networks allow solving many ill-posed inverse problems with unprecedented performance. Physics informed approaches already progressively replace carefully hand-crafted reconstruction algorithms in real application…

DeblurringImage Deblurring

An Unsupervised Approach to Solving Inverse Problems using Generative Adversarial Networks

2018-05-18 · Rushil Anirudh, Jayaraman J. Thiagarajan, Bhavya Kailkhura, Timo Bremer

Solving inverse problems continues to be a challenge in a wide array of applications ranging from deblurring, image inpainting, source separation etc. Most existing techniques solve such inverse problems by either explic…

blind source separationDeblurringImage DeblurringImage Inpainting