PC-GANs: Progressive Compensation Generative Adversarial Networks for Pan-sharpening
The fusion of multispectral and panchromatic images is always dubbed pansharpening. Most of the available deep learning-based pan-sharpening methods sharpen the multispectral images through a one-step scheme, which strongly depends on the reconstruction ability of the network. However, remote sensing images always have large variations, as a result, these one-step methods are vulnerable to the error accumulation and thus incapable of preserving spatial details as well as the spectral information. In this paper, we propose a novel two-step model for pan-sharpening that sharpens the MS image through the progressive compensation of the spatial and spectral information. Firstly, a deep multiscale guided generative adversarial network is used to preliminarily enhance the spatial resolution of the MS image. Starting from the pre-sharpened MS image in the coarse domain, our approach then progressively refines the spatial and spectral residuals over a couple of generative adversarial networks (GANs) that have reverse architectures. The whole model is composed of triple GANs, and based on the specific architecture, a joint compensation loss function is designed to enable the triple GANs to be trained simultaneously. Moreover, the spatial-spectral residual compensation structure proposed in this paper can be extended to other pan-sharpening methods to further enhance their fusion results. Extensive experiments are performed on different datasets and the results demonstrate the effectiveness and efficiency of our proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Generative Adversarial NetworkPansharpeningSimilar Papers 제목 키워드 기반
PSGAN: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening
This paper addresses the problem of remote sensing image pan-sharpening from the perspective of generative adversarial learning. We propose a novel deep neural network based method named PSGAN. To the best of our knowled…
Generative Adversarial NetworkInformation Compensation for Deep Conditional Generative Networks
In recent years, unsupervised/weakly-supervised conditional generative adversarial networks (GANs) have achieved many successes on the task of modeling and generating data. However, one of their weaknesses lies in their …
DisentanglementRethinking CNN-Based Pansharpening: Guided Colorization of Panchromatic Images via GANs
Convolutional Neural Networks (CNN)-based approaches have shown promising results in pansharpening of satellite images in recent years. However, they still exhibit limitations in producing high-quality pansharpening outp…
ColorizationPansharpeningSelf-Supervised LearningSuper-ResolutionPioneer Networks: Progressively Growing Generative Autoencoder
We introduce a novel generative autoencoder network model that learns to encode and reconstruct images with high quality and resolution, and supports smooth random sampling from the latent space of the encoder. Generativ…
Image GenerationHigh-Resolution Mammogram Synthesis using Progressive Generative Adversarial Networks
The ability to generate synthetic medical images is useful for data augmentation, domain transfer, and out-of-distribution detection. However, generating realistic, high-resolution medical images is challenging, particul…
Data AugmentationImage GenerationOut-of-Distribution DetectionVocal Bursts Intensity Prediction