REPNP: Plug-and-Play with Deep Reinforcement Learning Prior for Robust Image Restoration
Image restoration schemes based on the pre-trained deep models have received great attention due to their unique flexibility for solving various inverse problems. In particular, the Plug-and-Play (PnP) framework is a popular and powerful tool that can integrate an off-the-shelf deep denoiser for different image restoration tasks with known observation models. However, obtaining the observation model that exactly matches the actual one can be challenging in practice. Thus, the PnP schemes with conventional deep denoisers may fail to generate satisfying results in some real-world image restoration tasks. We argue that the robustness of the PnP framework is largely limited by using the off-the-shelf deep denoisers that are trained by deterministic optimization. To this end, we propose a novel deep reinforcement learning (DRL) based PnP framework, dubbed RePNP, by leveraging a light-weight DRL-based denoiser for robust image restoration tasks. Experimental results demonstrate that the proposed RePNP is robust to the observation model used in the PnP scheme deviating from the actual one. Thus, RePNP can generate more reliable restoration results for image deblurring and super resolution tasks. Compared with several state-of-the-art deep image restoration baselines, RePNP achieves better results subjective to model deviation with fewer model parameters.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringDeep Reinforcement LearningImage DeblurringImage Restorationreinforcement-learningReinforcement Learning (RL)Super-ResolutionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Plug-and-Play Image Restoration with Deep Denoiser Prior
Recent works on plug-and-play image restoration have shown that a denoiser can implicitly serve as the image prior for model-based methods to solve many inverse problems. Such a property induces considerable advantages f…
DeblurringDemosaickingImage RestorationSuper-ResolutionDeep Plug-and-Play Super-Resolution for Arbitrary Blur Kernels
While deep neural networks (DNN) based single image super-resolution (SISR) methods are rapidly gaining popularity, they are mainly designed for the widely-used bicubic degradation, and there still remains the fundamenta…
DeblurringImage RestorationImage Super-ResolutionSuper-ResolutionFrom the Gradient-Step Denoiser to the Proximal Denoiser and their associated convergent Plug-and-Play algorithms
In this paper we analyze the Gradient-Step Denoiser and its usage in Plug-and-Play algorithms. The Plug-and-Play paradigm of optimization algorithms uses off the shelf denoisers to replace a proximity operator or a gradi…
Investigating the Feasibility of Patch-based Inference for Generalized Diffusion Priors in Inverse Problems for Medical Images
Plug-and-play approaches to solving inverse problems such as restoration and super-resolution have recently benefited from Diffusion-based generative priors for natural as well as medical images. However, solutions often…
Super-ResolutionPreconditioned Plug-and-Play ADMM with Locally Adjustable Denoiser for Image Restoration
Plug-and-Play optimization recently emerged as a powerful technique for solving inverse problems by plugging a denoiser into a classical optimization algorithm. The denoiser accounts for the regularization and therefore …
DemosaickingDenoisingImage DenoisingImage Restoration