A Scale-Arbitrary Image Super-Resolution Network Using Frequency-domain Information
Image super-resolution (SR) is a technique to recover lost high-frequency information in low-resolution (LR) images. Spatial-domain information has been widely exploited to implement image SR, so a new trend is to involve frequency-domain information in SR tasks. Besides, image SR is typically application-oriented and various computer vision tasks call for image arbitrary magnification. Therefore, in this paper, we study image features in the frequency domain to design a novel scale-arbitrary image SR network. First, we statistically analyze LR-HR image pairs of several datasets under different scale factors and find that the high-frequency spectra of different images under different scale factors suffer from different degrees of degradation, but the valid low-frequency spectra tend to be retained within a certain distribution range. Then, based on this finding, we devise an adaptive scale-aware feature division mechanism using deep reinforcement learning, which can accurately and adaptively divide the frequency spectrum into the low-frequency part to be retained and the high-frequency one to be recovered. Finally, we design a scale-aware feature recovery module to capture and fuse multi-level features for reconstructing the high-frequency spectrum at arbitrary scale factors. Extensive experiments on public datasets show the superiority of our method compared with state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningImage Super-ResolutionSuper-ResolutionvalidSimilar Papers 제목 키워드 기반
Arbitrary-Resolution and Arbitrary-Scale Face Super-Resolution with Implicit Representation Networks
Face super-resolution (FSR) is a critical technique for enhancing low-resolution facial images and has significant implications for face-related tasks. However, existing FSR methods are limited by fixed up-sampling scale…
ASDN: A Deep Convolutional Network for Arbitrary Scale Image Super-Resolution
Deep convolutional neural networks have significantly improved the peak signal-to-noise ratio of SuperResolution (SR). However, image viewer applications commonly allow users to zoom the images to arbitrary magnification…
Image Super-ResolutionSuper-ResolutionFreqINR: Frequency Consistency for Implicit Neural Representation with Adaptive DCT Frequency Loss
Recent advancements in local Implicit Neural Representation (INR) demonstrate its exceptional capability in handling images at various resolutions. However, frequency discrepancies between high-resolution (HR) and ground…
Computational EfficiencySuper-ResolutionLocal Implicit Wavelet Transformer for Arbitrary-Scale Super-Resolution
Implicit neural representations have recently demonstrated promising potential in arbitrary-scale Super-Resolution (SR) of images. Most existing methods predict the pixel in the SR image based on the queried coordinate a…
Super-ResolutionHigh-Frequency Preserving Image Downscaler
The goal of downscaling an image is to reduce its resolution to a lower resolution, while maintaining the visual characteristics of the original image. Recent learning-based algorithms have shown great improvement over c…
DecoderVocal Bursts Intensity Prediction