paper-with-me

Papers

Finding Discriminative Filters for Specific Degradations in Blind Super-Resolution

2021-08-02 · NeurIPS 2021 12 · Liangbin Xie, Xintao Wang, Chao Dong, Zhongang Qi, Ying Shan

Recent blind super-resolution (SR) methods typically consist of two branches, one for degradation prediction and the other for conditional restoration. However, our experiments show that a one-branch network can achieve comparable performance to the two-branch scheme. Then we wonder: how can one-branch networks automatically learn to distinguish degradations? To find the answer, we propose a new diagnostic tool -- Filter Attribution method based on Integral Gradient (FAIG). Unlike previous integral gradient methods, our FAIG aims at finding the most discriminative filters instead of input pixels/features for degradation removal in blind SR networks. With the discovered filters, we further develop a simple yet effective method to predict the degradation of an input image. Based on FAIG, we show that, in one-branch blind SR networks, 1) we are able to find a very small number of (1%) discriminative filters for each specific degradation; 2) The weights, locations and connections of the discovered filters are all important to determine the specific network function. 3) The task of degradation prediction can be implicitly realized by these discriminative filters without explicit supervised learning. Our findings can not only help us better understand network behaviors inside one-branch blind SR networks, but also provide guidance on designing more efficient architectures and diagnosing networks for blind SR.

📄 PDF Abstract BibTeX arXiv:2108.01070

Code (1)

TencentARC/FAIG pytorch

Tasks

Blind Super-ResolutionDiagnosticSuper-Resolution

Similar Papers 제목 키워드 기반

All-in-One Image Restoration for Unknown Degradations Using Adaptive Discriminative Filters for Specific Degradations

2023-01-01 · CVPR 2023 1 · Dongwon Park, Byung Hyun Lee, Se Young Chun

Image restorations for single degradations have been widely studied, demonstrating excellent performance for each degradation, but can not reflect unpredictable realistic environments with unknown multiple degradatio…

AllImage Restoration

Learning Correction Filter via Degradation-Adaptive Regression for Blind Single Image Super-Resolution

2023-01-01 · ICCV 2023 1 · Hongyang Zhou, Xiaobin Zhu, Jianqing Zhu, Zheng Han 외

Although existing image deep learning super-resolution (SR) methods achieve promising performance on benchmark datasets, they still suffer from severe performance drops when the degradation of the low-resolution (LR)…

Image Super-ResolutionregressionSuper-Resolution

Unsupervised Degradation Representation Learning for Blind Super-Resolution

2021-04-01 · CVPR 2021 1 · Longguang Wang, Yingqian Wang, Xiaoyu Dong, Qingyu Xu 외

Most existing CNN-based super-resolution (SR) methods are developed based on an assumption that the degradation is fixed and known (e.g., bicubic downsampling). However, these methods suffer a severe performance drop whe…

Blind Super-ResolutionRepresentation LearningSuper-Resolution

Federated Learning for Blind Image Super-Resolution

2024-04-26 · Brian B. Moser, Ahmed Anwar, Federico Raue, Stanislav Frolov 외

Traditional blind image SR methods need to model real-world degradations precisely. Consequently, current research struggles with this dilemma by assuming idealized degradations, which leads to limited applicability to a…

Federated LearningImage Super-ResolutionSuper-Resolution

From General to Specific: Online Updating for Blind Super-Resolution

2021-07-06 · Shang Li, GuiXuan Zhang, Zhengxiong Luo, Jie Liu 외

Most deep learning-based super-resolution (SR) methods are not image-specific: 1) They are trained on samples synthesized by predefined degradations (e.g. bicubic downsampling), regardless of the domain gap between train…

Blind Super-ResolutionSuper-Resolution