paper-with-me

Papers

UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity

2024-12-28 · Jingbo Lin, Zhilu Zhang, Wenbo Li, Renjing Pei, Hang Xu, Hongzhi Zhang, WangMeng Zuo

Recently, considerable progress has been made in allin-one image restoration. Generally, existing methods can be degradation-agnostic or degradation-aware. However, the former are limited in leveraging degradation-specific restoration, and the latter suffer from the inevitable error in degradation estimation. Consequently, the performance of existing methods has a large gap compared to specific single-task models. In this work, we make a step forward in this topic, and present our UniRestorer with improved restoration performance. Specifically, we perform hierarchical clustering on degradation space, and train a multi-granularity mixture-of-experts (MoE) restoration model. Then, UniRestorer adopts both degradation and granularity estimation to adaptively select an appropriate expert for image restoration. In contrast to existing degradation-agnostic and -aware methods, UniRestorer can leverage degradation estimation to benefit degradationspecific restoration, and use granularity estimation to make the model robust to degradation estimation error. Experimental results show that our UniRestorer outperforms stateof-the-art all-in-one methods by a large margin, and is promising in closing the performance gap to specific single task models. The code and pre-trained models will be publicly available at https://github.com/mrluin/UniRestorer.

📄 PDF Abstract BibTeX arXiv:2412.20157

Code (1)

mrluin/unirestorer 공식 구현 pytorch

Tasks

Image RestorationMixture-of-Experts

Similar Papers 제목 키워드 기반

UIR-LoRA: Achieving Universal Image Restoration through Multiple Low-Rank Adaptation

2024-09-30 · Cheng Zhang, Dong Gong, Jiumei He, Yu Zhu 외

Existing unified methods typically treat multi-degradation image restoration as a multi-task learning problem. Despite performing effectively compared to single degradation restoration methods, they overlook the utilizat…

Image RestorationMulti-Task LearningTransfer LearningUnified Image Restoration

Universal Face Restoration With Memorized Modulation

2021-10-03 · Jia Li, Huaibo Huang, Xiaofei Jia, Ran He

Blind face restoration (BFR) is a challenging problem because of the uncertainty of the degradation patterns. This paper proposes a Restoration with Memorized Modulation (RMM) framework for universal BFR in diverse degra…

Blind Face Restoration

ProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restoration

2023-06-23 · Jiaqi Ma, Tianheng Cheng, Guoli Wang, Qian Zhang 외

Image restoration aims to reconstruct degraded images, e.g., denoising or deblurring. Existing works focus on designing task-specific methods and there are inadequate attempts at universal methods. However, simply unifyi…

DeblurringDenoisingImage RestorationLow-Light Image Enhancement+3

Prompt-In-Prompt Learning for Universal Image Restoration

2023-12-08 · Zilong Li, Yiming Lei, Chenglong Ma, Junping Zhang 외

Image restoration, which aims to retrieve and enhance degraded images, is fundamental across a wide range of applications. While conventional deep learning approaches have notably improved the image quality across variou…

DeblurringDenoisingImage DenoisingImage Restoration+2

UnSCAR: Universal, Scalable, Controllable, and Adaptable Image Restoration

2026-03-08 · Debabrata Mandal, Soumitri Chattopadhyay, Yujie Wang, Marc Niethammer 외 arxiv

Universal image restoration aims to recover clean images from arbitrary real-world degradations using a single inference model. Despite significant progress, existing all-in-one restoration networks do not scale to multi…

Image Restoration