Semantically Robust Unsupervised Image Translation for Paired Remote Sensing Images
Image translation for change detection or classification in bi-temporal remote sensing images is unique. Although it can acquire paired images, it is still unsupervised. Moreover, strict semantic preservation in translation is always needed instead of multimodal outputs. In response to these problems, this paper proposes a new method, SRUIT (Semantically Robust Unsupervised Image-to-image Translation), which ensures semantically robust translation and produces deterministic output. Inspired by previous works, the method explores the underlying characteristics of bi-temporal Remote Sensing images and designs the corresponding networks. Firstly, we assume that bi-temporal Remote Sensing images share the same latent space, for they are always acquired from the same land location. So SRUIT makes the generators share their high-level layers, and this constraint will compel two domain mapping to fall into the same latent space. Secondly, considering land covers of bi-temporal images could evolve into each other, SRUIT exploits the cross-cycle-consistent adversarial networks to translate from one to the other and recover them. Experimental results show that constraints of sharing weights and cross-cycle consistency enable translated images with both good perceptual image quality and semantic preservation for significant differences.
Code (0)
등록된 구현이 없습니다.
Tasks
Change DetectionImage-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationSimilar Papers 제목 키워드 기반
UCTGAN: Diverse Image Inpainting Based on Unsupervised Cross-Space Translation
Although existing image inpainting approaches have been able to produce visually realistic and semantically correct results, they produce only one result for each masked input. In order to produce multiple and diverse re…
DiversityGenerative Adversarial NetworkImage InpaintingTranslationExtremely Weak Supervised Image-to-Image Translation for Semantic Segmentation
Recent advances in generative models and adversarial training have led to a flourishing image-to-image (I2I) translation literature. The current I2I translation approaches require training images from the two domains tha…
Image SegmentationImage-to-Image TranslationSemantic SegmentationTranslationMCMI: Multi-Cycle Image Translation with Mutual Information Constraints
We present a mutual information-based framework for unsupervised image-to-image translation. Our MCMI approach treats single-cycle image translation models as modules that can be used recurrently in a multi-cycle transla…
Image-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationSemantically Robust Unpaired Image Translation for Data with Unmatched Semantics Statistics
Many applications of unpaired image-to-image translation require the input contents to be preserved semantically during translations. Unaware of the inherently unmatched semantics distributions between source and target …
Image-to-Image TranslationTranslationFlowEO: Generative Unsupervised Domain Adaptation for Earth Observation
The increasing availability of Earth observation data offers unprecedented opportunities for large-scale environmental monitoring and analysis. However, these datasets are inherently heterogeneous, stemming from diverse …
Unsupervised Domain AdaptationSemantic Segmentation