DRM-IR: Task-Adaptive Deep Unfolding Network for All-In-One Image Restoration
Existing All-In-One image restoration (IR) methods usually lack flexible modeling on various types of degradation, thus impeding the restoration performance. To achieve All-In-One IR with higher task dexterity, this work proposes an efficient Dynamic Reference Modeling paradigm (DRM-IR), which consists of task-adaptive degradation modeling and model-based image restoring. Specifically, these two subtasks are formalized as a pair of entangled reference-based maximum a posteriori (MAP) inferences, which are optimized synchronously in an unfolding-based manner. With the two cascaded subtasks, DRM-IR first dynamically models the task-specific degradation based on a reference image pair and further restores the image with the collected degradation statistics. Besides, to bridge the semantic gap between the reference and target degraded images, we further devise a Degradation Prior Transmitter (DPT) that restrains the instance-specific feature differences. DRM-IR explicitly provides superior flexibility for All-in-One IR while being interpretable. Extensive experiments on multiple benchmark datasets show that our DRM-IR achieves state-of-the-art in All-In-One IR.
Code (0)
등록된 구현이 없습니다.
Tasks
AllImage RestorationSimilar Papers 제목 키워드 기반
Deep Generalized Unfolding Networks for Image Restoration
Deep neural networks (DNN) have achieved great success in image restoration. However, most DNN methods are designed as a black box, lacking transparency and interpretability. Although some methods are proposed to combine…
Image RestorationVision-Language Gradient Descent-driven All-in-One Deep Unfolding Networks
Dynamic image degradations, including noise, blur and lighting inconsistencies, pose significant challenges in image restoration, often due to sensor limitations or adverse environmental conditions. Existing Deep Unfoldi…
AllImage RestorationRain RemovalDVANet: Degradation-aware Visual-prior Alignment Network for Image Restoration
All-in-One image restoration aims to develop a unified restoration framework for handling diverse degradation types. Existing end-to-end methods usually regard the restoration process as a black-box mapping, lacking an e…
Unified Image RestorationDIVA: Deep Unfolded Network from Quantum Interactive Patches for Image Restoration
This paper presents a deep neural network called DIVA unfolding a baseline adaptive denoising algorithm (De-QuIP), relying on the theory of quantum many-body physics. Furthermore, it is shown that with very slight modifi…
DeblurringDenoisingImage DeblurringImage Restoration+1Nested Unfolding Network for Real-World Concealed Object Segmentation
Deep unfolding networks (DUNs) have recently advanced concealed object segmentation (COS) by modeling segmentation as iterative foreground-background separation. However, existing DUN-based methods (RUN) inherently coupl…
Object SegmentationImage Restoration