paper-with-me

Papers

Solving Inverse Problems with Flow-based Models via Model Predictive Control

2026-01-30 · George Webber, Alexander Denker, Riccardo Barbano, Andrew J Reader arxiv

Flow-based generative models provide strong unconditional priors for inverse problems, but guiding their dynamics for conditional generation remains challenging. Recent work casts training-free conditional generation in flow models as an optimal control problem; however, solving the resulting trajectory optimisation is computationally and memory intensive, requiring differentiation through the flow dynamics or adjoint solves. We propose MPC-Flow, a model predictive control framework that formulates inverse problem solving with flow-based generative models as a sequence of control sub-problems, enabling practical optimal control-based guidance at inference time. We provide theoretical analysis linking MPC-Flow to the underlying optimal control objective and show how different algorithmic choices yield a spectrum of guidance algorithms, including regimes that avoid backpropagation through the generative model trajectory. We evaluate MPC-Flow on benchmark image restoration tasks, spanning linear and non-linear settings such as in-painting, deblurring, and super-resolution, and demonstrate strong performance and scalability to massive state-of-the-art architectures via training-free guidance of FLUX.2 (32B) in a quantised setting on consumer hardware.

📄 PDF Abstract BibTeX arXiv:2601.23231

Code (0)

등록된 구현이 없습니다.

Tasks

Image Restoration

Similar Papers 제목 키워드 기반

D-Flow: Differentiating through Flows for Controlled Generation

2024-02-21 · Heli Ben-Hamu, Omri Puny, Itai Gat, Brian Karrer 외

Taming the generation outcome of state of the art Diffusion and Flow-Matching (FM) models without having to re-train a task-specific model unlocks a powerful tool for solving inverse problems, conditional generation, and…

Solving Inverse Problems with a Flow-based Noise Model

2020-03-18 · Jay Whang, Qi Lei, Alexandros G. Dimakis

We study image inverse problems with a normalizing flow prior. Our formulation views the solution as the maximum a posteriori estimate of the image conditioned on the measurements. This formulation allows us to use noise…

compressed sensingDenoising

Training-free Linear Image Inverses via Flows

2023-09-25 · Ashwini Pokle, Matthew J. Muckley, Ricky T. Q. Chen, Brian Karrer

Solving inverse problems without any training involves using a pretrained generative model and making appropriate modifications to the generation process to avoid finetuning of the generative model. While recent methods …

Trajectory Stitching for Solving Inverse Problems with Flow-Based Models

2026-02-09 · Alexander Denker, Moshe Eliasof, Zeljko Kereta, Carola-Bibiane Schönlieb arxiv

Flow-based generative models have emerged as powerful priors for solving inverse problems. One option is to directly optimize the initial latent code (noise), such that the flow output solves the inverse problem. However…

Fast Samplers for Inverse Problems in Iterative Refinement Models

2024-05-27 · Kushagra Pandey, Ruihan Yang, Stephan Mandt

Constructing fast samplers for unconditional diffusion and flow-matching models has received much attention recently; however, existing methods for solving inverse problems, such as super-resolution, inpainting, or deblu…

DeblurringImage RestorationSuper-Resolution