Self-Supervised CycleGAN for Object-Preserving Image-to-Image Domain Adaptation
Recent generative adversarial network (GAN) based methods (e.g., CycleGAN) are prone to fail at preserving image-objects in image-to-image translation, which reduces their practicality on tasks such as domain adaptation. Some frameworks have been proposed to adopt a segmentation network as the auxiliary regularization to prevent the content distortion. However, all of them require extra pixel-wise annotations, which is difficult to fulfill in practical applications. In this paper, we propose a novel GAN (namely OP-GAN) to address the problem, which involves a self-supervised module to enforce the image content consistency during image-to-image translations without any extra annotations. We evaluate the proposed OP-GAN on three publicly available datasets. The experimental results demonstrate that our OP-GAN can yield visually plausible translated images and significantly improve the semantic segmentation accuracy in different domain adaptation scenarios with off-the-shelf deep learning networks such as PSPNet and U-Net.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationGenerative Adversarial NetworkImage-to-Image TranslationSegmentationSemantic SegmentationTranslationSimilar Papers 제목 키워드 기반
Federated CycleGAN for Privacy-Preserving Image-to-Image Translation
Unsupervised image-to-image translation methods such as CycleGAN learn to convert images from one domain to another using unpaired training data sets from different domains. Unfortunately, these approaches still require …
Federated LearningImage-to-Image TranslationPrivacy PreservingTranslation+1Federated Contrastive Learning for Privacy-Preserving Unpaired Image-to-Image Translation
The goal of an unsupervised image-to-image translation (I2I) is to convert an input image in a specific domain to a target domain using a neural network trained with unpaired data. Existing I2I methods usually require a …
Contrastive LearningImage-to-Image TranslationPrivacy PreservingTranslation+1Feature Fusion Attention Network with CycleGAN for Image Dehazing, De-Snowing and De-Raining
This paper presents a novel approach to image dehazing by combining Feature Fusion Attention (FFA) networks with CycleGAN architecture. Our method leverages both supervised and unsupervised learning techniques to effecti…
Image DehazingSSIMMutually improved endoscopic image synthesis and landmark detection in unpaired image-to-image translation
The CycleGAN framework allows for unsupervised image-to-image translation of unpaired data. In a scenario of surgical training on a physical surgical simulator, this method can be used to transform endoscopic images of p…
Image GenerationImage-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationxAI-CycleGAN, a Cycle-Consistent Generative Assistive Network
In the domain of unsupervised image-to-image transformation using generative transformative models, CycleGAN has become the architecture of choice. One of the primary downsides of this architecture is its relatively slow…
counterfactualExplainable Artificial Intelligence (XAI)