Semantically Accurate Super-Resolution Generative Adversarial Networks
This work addresses the problems of semantic segmentation and image super-resolution by jointly considering the performance of both in training a Generative Adversarial Network (GAN). We propose a novel architecture and domain-specific feature loss, allowing super-resolution to operate as a pre-processing step to increase the performance of downstream computer vision tasks, specifically semantic segmentation. We demonstrate this approach using Nearmap's aerial imagery dataset which covers hundreds of urban areas at 5-7 cm per pixel resolution. We show the proposed approach improves perceived image quality as well as quantitative segmentation accuracy across all prediction classes, yielding an average accuracy improvement of 11.8% and 108% at 4x and 32x super-resolution, compared with state-of-the art single-network methods. This work demonstrates that jointly considering image-based and task-specific losses can improve the performance of both, and advances the state-of-the-art in semantic-aware super-resolution of aerial imagery.
Code (0)
등록된 구현이 없습니다.
Tasks
Generative Adversarial NetworkImage Super-ResolutionSegmentationSemantic SegmentationSuper-ResolutionSimilar Papers 제목 키워드 기반
Unsupervised Projection Networks for Generative Adversarial Networks
We propose the use of unsupervised learning to train projection networks that project onto the latent space of an already trained generator. We apply our method to a trained StyleGAN, and use our projection network to pe…
ClusteringImage Super-ResolutionSuper-ResolutionZooming Out on Zooming In: Advancing Super-Resolution for Remote Sensing
Super-Resolution for remote sensing has the potential for huge impact on planet monitoring by producing accurate and realistic high resolution imagery on a frequent basis and a global scale. Despite a lot of attention, s…
Super-ResolutionInfrared Image Super-Resolution via GAN
The ability of generative models to accurately fit data distributions has resulted in their widespread adoption and success in fields such as computer vision and natural language processing. In this chapter, we provide a…
Image Super-ResolutionInfrared image super-resolutionSuper-ResolutionSuper-Resolution of 3D Micro-CT Images Using Generative Adversarial Networks: Enhancing Resolution and Segmentation Accuracy
We develop a procedure for substantially improving the quality of segmented 3D micro-Computed Tomography (micro-CT) images of rocks with a Machine Learning (ML) Generative Model. The proposed model enhances the resolutio…
Generative Adversarial NetworkSuper-ResolutionUnsupervised Image Super-Resolution using Cycle-in-Cycle Generative Adversarial Networks
We consider the single image super-resolution problem in a more general case that the low-/high-resolution pairs and the down-sampling process are unavailable. Different from traditional super-resolution formulation, the…
Image Super-ResolutionImage-to-Image TranslationSuper-ResolutionTranslation