paper-with-me

홈 › Papers

Plug-and-Play Deep Energy Model for Inverse problems

2023-02-15 · Jyothi Rikabh Chand, Mathews Jacob

We introduce a novel energy formulation for Plug- and-Play (PnP) image recovery. Traditional PnP methods that use a convolutional neural network (CNN) do not have an energy based formulation. The primary focus of this work is to introduce an energy-based PnP formulation, which relies on a CNN that learns the log of the image prior from training data. The score function is evaluated as the gradient of the energy model, which resembles a UNET with shared encoder and decoder weights. The proposed score function is thus constrained to a conservative vector field, which is the key difference with classical PnP models. The energy-based formulation offers algorithms with convergence guarantees, even when the learned score model is not a contraction. The relaxation of the contraction constraint allows the proposed model to learn more complex priors, thus offering improved performance over traditional PnP schemes. Our experiments in magnetic resonance image reconstruction demonstrates the improved performance offered by the proposed energy model over traditional PnP methods.

📄 PDF Abstract BibTeX arXiv:2302.11570

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderImage Reconstruction

Methods 이 논문이 사용한 방법론

PnP PnP, or Poll and Pool, is sampling module extension for DETR-type architectures that adaptively allocates its computation…

Similar Papers 제목 키워드 기반

InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciences

2025-03-14 · Hongkai Zheng, Wenda Chu, Bingliang Zhang, Zihui Wu 외

Plug-and-play diffusion priors (PnPDP) have emerged as a promising research direction for solving inverse problems. However, current studies primarily focus on natural image restoration, leaving the performance of these …

BenchmarkingImage Restoration

MAP Image Recovery with Guarantees using Locally Convex Multi-Scale Energy (LC-MUSE) Model

2025-02-05 · Jyothi Rikhab Chand, Mathews Jacob

We propose a multi-scale deep energy model that is strongly convex in the local neighbourhood around the data manifold to represent its probability density, with application in inverse problems. In particular, we represe…

Image Reconstruction

Energy Dissipation with Plug-and-Play Priors

2019-09-14 · NeurIPS Workshop Deep_Invers 2019 12 · Hendrik Sommerhoff, Andreas Kolb, Michael Moeller

Neural networks have reached outstanding performance for solving various ill-posed inverse problems in imaging. However, drawbacks of end-to-end learning approaches in comparison to classical variational methods are the …

DenoisingImage Denoising

Inverse problem regularization with hierarchical variational autoencoders

2023-03-20 · ICCV 2023 1 · Jean Prost, Antoine Houdard, Andrés Almansa, Nicolas Papadakis

In this paper, we propose to regularize ill-posed inverse problems using a deep hierarchical variational autoencoder (HVAE) as an image prior. The proposed method synthesizes the advantages of i) denoiser-based Plug \& P…

Image Restoration

Single-Shot Plug-and-Play Methods for Inverse Problems

2023-11-22 · Yanqi Cheng, Lipei Zhang, Zhenda Shen, Shujun Wang 외

The utilisation of Plug-and-Play (PnP) priors in inverse problems has become increasingly prominent in recent years. This preference is based on the mathematical equivalence between the general proximal operator and the …