UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity
Recently, considerable progress has been made in allin-one image restoration. Generally, existing methods can be degradation-agnostic or degradation-aware. However, the former are limited in leveraging degradation-specific restoration, and the latter suffer from the inevitable error in degradation estimation. Consequently, the performance of existing methods has a large gap compared to specific single-task models. In this work, we make a step forward in this topic, and present our UniRestorer with improved restoration performance. Specifically, we perform hierarchical clustering on degradation space, and train a multi-granularity mixture-of-experts (MoE) restoration model. Then, UniRestorer adopts both degradation and granularity estimation to adaptively select an appropriate expert for image restoration. In contrast to existing degradation-agnostic and -aware methods, UniRestorer can leverage degradation estimation to benefit degradationspecific restoration, and use granularity estimation to make the model robust to degradation estimation error. Experimental results show that our UniRestorer outperforms stateof-the-art all-in-one methods by a large margin, and is promising in closing the performance gap to specific single task models. The code and pre-trained models will be publicly available at https://github.com/mrluin/UniRestorer.
Code (1)
Tasks
Image RestorationMixture-of-ExpertsSimilar Papers 제목 키워드 기반
UIR-LoRA: Achieving Universal Image Restoration through Multiple Low-Rank Adaptation
Existing unified methods typically treat multi-degradation image restoration as a multi-task learning problem. Despite performing effectively compared to single degradation restoration methods, they overlook the utilizat…
Image RestorationMulti-Task LearningTransfer LearningUnified Image RestorationUniversal Face Restoration With Memorized Modulation
Blind face restoration (BFR) is a challenging problem because of the uncertainty of the degradation patterns. This paper proposes a Restoration with Memorized Modulation (RMM) framework for universal BFR in diverse degra…
Blind Face RestorationProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restoration
Image restoration aims to reconstruct degraded images, e.g., denoising or deblurring. Existing works focus on designing task-specific methods and there are inadequate attempts at universal methods. However, simply unifyi…
DeblurringDenoisingImage RestorationLow-Light Image Enhancement+3Prompt-In-Prompt Learning for Universal Image Restoration
Image restoration, which aims to retrieve and enhance degraded images, is fundamental across a wide range of applications. While conventional deep learning approaches have notably improved the image quality across variou…
DeblurringDenoisingImage DenoisingImage Restoration+2UnSCAR: Universal, Scalable, Controllable, and Adaptable Image Restoration
Universal image restoration aims to recover clean images from arbitrary real-world degradations using a single inference model. Despite significant progress, existing all-in-one restoration networks do not scale to multi…
Image Restoration