paper-with-me

Papers

Efficient Test-Time Adaptation for Super-Resolution with Second-Order Degradation and Reconstruction

2023-10-29 · NeurIPS 2023 11 · Zeshuai Deng, Zhuokun Chen, Shuaicheng Niu, Thomas H. Li, Bohan Zhuang, Mingkui Tan

Image super-resolution (SR) aims to learn a mapping from low-resolution (LR) to high-resolution (HR) using paired HR-LR training images. Conventional SR methods typically gather the paired training data by synthesizing LR images from HR images using a predetermined degradation model, e.g., Bicubic down-sampling. However, the realistic degradation type of test images may mismatch with the training-time degradation type due to the dynamic changes of the real-world scenarios, resulting in inferior-quality SR images. To address this, existing methods attempt to estimate the degradation model and train an image-specific model, which, however, is quite time-consuming and impracticable to handle rapidly changing domain shifts. Moreover, these methods largely concentrate on the estimation of one degradation type (e.g., blur degradation), overlooking other degradation types like noise and JPEG in real-world test-time scenarios, thus limiting their practicality. To tackle these problems, we present an efficient test-time adaptation framework for SR, named SRTTA, which is able to quickly adapt SR models to test domains with different/unknown degradation types. Specifically, we design a second-order degradation scheme to construct paired data based on the degradation type of the test image, which is predicted by a pre-trained degradation classifier. Then, we adapt the SR model by implementing feature-level reconstruction learning from the initial test image to its second-order degraded counterparts, which helps the SR model generate plausible HR images. Extensive experiments are conducted on newly synthesized corrupted DIV2K datasets with 8 different degradations and several real-world datasets, demonstrating that our SRTTA framework achieves an impressive improvement over existing methods with satisfying speed. The source code is available at https://github.com/DengZeshuai/SRTTA.

📄 PDF Abstract BibTeX arXiv:2310.19011

Code (1)

dengzeshuai/srtta 공식 구현 pytorch

Tasks

Image Super-ResolutionSuper-ResolutionTest-time Adaptation

Similar Papers 제목 키워드 기반

Fast Adaptation to Super-Resolution Networks via Meta-Learning

2020-01-09 · ECCV 2020 8 · Seobin Park, Jinsu Yoo, Donghyeon Cho, Jiwon Kim 외

Conventional supervised super-resolution (SR) approaches are trained with massive external SR datasets but fail to exploit desirable properties of the given test image. On the other hand, self-supervised SR approaches ut…

Meta-LearningSuper-Resolution

Self-Supervised Adaptation for Video Super-Resolution

2021-03-18 · Jinsu Yoo, Tae Hyun Kim

Recent single-image super-resolution (SISR) networks, which can adapt their network parameters to specific input images, have shown promising results by exploiting the information available within the input data as well …

Image Super-ResolutionKnowledge DistillationSuper-ResolutionVideo Super-Resolution

Single Image Super Resolution - When Model Adaptation Matters

2017-03-31 · Yudong Liang, Radu Timofte, Jinjun Wang, Yihong Gong 외

In the recent years impressive advances were made for single image super-resolution. Deep learning is behind a big part of this success. Deep(er) architecture design and external priors modeling are the key ingredients. …

Image Super-ResolutionSuper-Resolution

Cyclic Test-Time Adaptation on Monocular Video for 3D Human Mesh Reconstruction

2023-08-12 · ICCV 2023 1 · Hyeongjin Nam, Daniel Sungho Jung, Yeonguk Oh, Kyoung Mu Lee

Despite recent advances in 3D human mesh reconstruction, domain gap between training and test data is still a major challenge. Several prior works tackle the domain gap problem via test-time adaptation that fine-tunes a …

3D Human Pose EstimationDenoisingTest-time Adaptation

CAT: A Conditional Adaptation Tailor for Efficient and Effective Instance-Specific Pansharpening on Real-World Data

2025-04-14 · Tianyu Xin, Jin-Liang Xiao, Zeyu Xia, Shan Yin 외

Pansharpening is a crucial remote sensing technique that fuses low-resolution multispectral (LRMS) images with high-resolution panchromatic (PAN) images to generate high-resolution multispectral (HRMS) imagery. Although …

Computational EfficiencyGPUPansharpening