Simple and Efficient Unpaired Real-world Super-Resolution using Image Statistics
Learning super-resolution (SR) network without the paired low resolution (LR) and high resolution (HR) image is difficult because direct supervision through the corresponding HR counterpart is unavailable. Recently, many real-world SR researches take advantage of the unpaired image-to-image translation technique. That is, they used two or more generative adversarial networks (GANs), each of which translates images from one domain to another domain, \eg, translates images from the HR domain to the LR domain. However, it is not easy to stably learn such a translation with GANs using unpaired data. In this study, we present a simple and efficient method of training of real-world SR network. To stably train the network, we use statistics of an image patch, such as means and variances. Our real-world SR framework consists of two GANs, one for translating HR images to LR images (degradation task) and the other for translating LR to HR (SR task). We argue that the unpaired image translation using GANs can be learned efficiently with our proposed data sampling strategy, namely, variance matching. We test our method on the NTIRE 2020 real-world SR dataset. Our method outperforms the current state-of-the-art method in terms of the SSIM metric as well as produces comparable results on the LPIPS metric.
Code (0)
등록된 구현이 없습니다.
Tasks
Image-to-Image TranslationSSIMSuper-ResolutionTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unpaired Depth Super-Resolution in the Wild
Depth maps captured with commodity sensors are often of low quality and resolution; these maps need to be enhanced to be used in many applications. State-of-the-art data-driven methods of depth map super-resolution rely …
Depth Map Super-ResolutionImage-to-Image TranslationSuper-ResolutionTranslationAn Optimal Transport Perspective on Unpaired Image Super-Resolution
Real-world image super-resolution (SR) tasks often do not have paired datasets, which limits the application of supervised techniques. As a result, the tasks are usually approached by unpaired techniques based on Generat…
Image Super-ResolutionSuper-ResolutionUnsupervised Real-World Super-Resolution: A Domain Adaptation Perspective
Most existing convolution neural network (CNN) based super-resolution (SR) methods generate their paired training dataset by artificially synthesizing low-resolution (LR) images from the high-resolution (HR) ones. Ho…
Domain AdaptationImage-to-Image TranslationSuper-ResolutionLearning Coupled Dictionaries from Unpaired Data for Image Super-Resolution
The difficulty of acquiring high-resolution (HR) and low-resolution (LR) image pairs in real scenarios limits the performance of existing learning-based image super-resolution (SR) methods in the real world. To condu…
DiversityImage GenerationImage Super-ResolutionSuper-ResolutionTo learn image super-resolution, use a GAN to learn how to do image degradation first
This paper is on image and face super-resolution. The vast majority of prior work for this problem focus on how to increase the resolution of low-resolution images which are artificially generated by simple bilinear down…
Generative Adversarial NetworkImage Super-ResolutionSuper-Resolution