paper-with-me

홈 › Papers

REPNP: Plug-and-Play with Deep Reinforcement Learning Prior for Robust Image Restoration

2022-07-25 · Chong Wang, Rongkai Zhang, Saiprasad Ravishankar, Bihan Wen

Image restoration schemes based on the pre-trained deep models have received great attention due to their unique flexibility for solving various inverse problems. In particular, the Plug-and-Play (PnP) framework is a popular and powerful tool that can integrate an off-the-shelf deep denoiser for different image restoration tasks with known observation models. However, obtaining the observation model that exactly matches the actual one can be challenging in practice. Thus, the PnP schemes with conventional deep denoisers may fail to generate satisfying results in some real-world image restoration tasks. We argue that the robustness of the PnP framework is largely limited by using the off-the-shelf deep denoisers that are trained by deterministic optimization. To this end, we propose a novel deep reinforcement learning (DRL) based PnP framework, dubbed RePNP, by leveraging a light-weight DRL-based denoiser for robust image restoration tasks. Experimental results demonstrate that the proposed RePNP is robust to the observation model used in the PnP scheme deviating from the actual one. Thus, RePNP can generate more reliable restoration results for image deblurring and super resolution tasks. Compared with several state-of-the-art deep image restoration baselines, RePNP achieves better results subjective to model deviation with fewer model parameters.

📄 PDF Abstract BibTeX arXiv:2207.12056

Code (0)

등록된 구현이 없습니다.

Tasks

DeblurringDeep Reinforcement LearningImage DeblurringImage Restorationreinforcement-learningReinforcement Learning (RL)Super-Resolution

Methods 이 논문이 사용한 방법론

PnP PnP, or Poll and Pool, is sampling module extension for DETR-type architectures that adaptively allocates its computation…

Similar Papers 제목 키워드 기반

Plug-and-Play Image Restoration with Deep Denoiser Prior

2020-08-31 · Kai Zhang, Yawei Li, WangMeng Zuo, Lei Zhang 외

Recent works on plug-and-play image restoration have shown that a denoiser can implicitly serve as the image prior for model-based methods to solve many inverse problems. Such a property induces considerable advantages f…

DeblurringDemosaickingImage RestorationSuper-Resolution

Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernels

2019-03-29 · CVPR 2019 6 · Kai Zhang, WangMeng Zuo, Lei Zhang

While deep neural networks (DNN) based single image super-resolution (SISR) methods are rapidly gaining popularity, they are mainly designed for the widely-used bicubic degradation, and there still remains the fundamenta…

DeblurringImage RestorationImage Super-ResolutionSuper-Resolution

From the Gradient-Step Denoiser to the Proximal Denoiser and their associated convergent Plug-and-Play algorithms

2025-09-11 · Vincent Herfeld, Baudouin Denis de Senneville, Arthur Leclaire, Nicolas Papadakis arxiv

In this paper we analyze the Gradient-Step Denoiser and its usage in Plug-and-Play algorithms. The Plug-and-Play paradigm of optimization algorithms uses off the shelf denoisers to replace a proximity operator or a gradi…

Investigating the Feasibility of Patch-based Inference for Generalized Diffusion Priors in Inverse Problems for Medical Images

2025-01-25 · Saikat Roy, Mahmoud Mostapha, Radu Miron, Matt Holbrook 외

Plug-and-play approaches to solving inverse problems such as restoration and super-resolution have recently benefited from Diffusion-based generative priors for natural as well as medical images. However, solutions often…

Super-Resolution

Preconditioned Plug-and-Play ADMM with Locally Adjustable Denoiser for Image Restoration

2021-10-01 · Mikael Le Pendu, Christine Guillemot

Plug-and-Play optimization recently emerged as a powerful technique for solving inverse problems by plugging a denoiser into a classical optimization algorithm. The denoiser accounts for the regularization and therefore …

DemosaickingDenoisingImage DenoisingImage Restoration