Toward Zero-Shot Unsupervised Image-to-Image Translation
Recent studies have shown remarkable success in unsupervised image-to-image translation. However, if there has no access to enough images in target classes, learning a mapping from source classes to the target classes always suffers from mode collapse, which limits the application of the existing methods. In this work, we propose a zero-shot unsupervised image-to-image translation framework to address this limitation, by associating categories with their side information like attributes. To generalize the translator to previous unseen classes, we introduce two strategies for exploiting the space spanned by the semantic attributes. Specifically, we propose to preserve semantic relations to the visual space and expand attribute space by utilizing attribute vectors of unseen classes, thus encourage the translator to explore the modes of unseen classes. Quantitative and qualitative results on different datasets demonstrate the effectiveness of our proposed approach. Moreover, we demonstrate that our framework can be applied to many tasks, such as zero-shot classification and fashion design.
Code (1)
Tasks
AttributeImage-to-Image TranslationTranslationUnsupervised Image-To-Image Translationzero-shot-classificationZero-Shot LearningSimilar Papers 제목 키워드 기반
ZstGAN: An Adversarial Approach for Unsupervised Zero-Shot Image-to-Image Translation
Image-to-image translation models have shown remarkable ability on transferring images among different domains. Most of existing work follows the setting that the source domain and target domain keep the same at training…
AttributeImage GenerationImage-to-Image TranslationTranslation+1Diffusion based Zero-shot Medical Image-to-Image Translation for Cross Modality Segmentation
Cross-modality image segmentation aims to segment the target modalities using a method designed in the source modality. Deep generative models can translate the target modality images into the source modality, thus enabl…
Image SegmentationImage-to-Image TranslationSegmentationSemantic Segmentation+2Exploring selective image matching methods for zero-shot and few-sample unsupervised domain adaptation of urban canopy prediction
We explore simple methods for adapting a trained multi-task UNet which predicts canopy cover and height to a new geographic setting using remotely sensed data without the need of training a domain-adaptive classifier and…
Domain AdaptationImage-to-Image TranslationUnsupervised Domain AdaptationUnsupervised Neural Machine Translation with Generative Language Models Only
We show how to derive state-of-the-art unsupervised neural machine translation systems from generatively pre-trained language models. Our method consists of three steps: few-shot amplification, distillation, and backtran…
Language ModelingLanguage ModellingMachine TranslationTranslationZero-Shot Language Transfer vs Iterative Back Translation for Unsupervised Machine Translation
This work focuses on comparing different solutions for machine translation on low resource language pairs, namely, with zero-shot transfer learning and unsupervised machine translation. We discuss how the data size affec…
Machine TranslationTransfer LearningTranslationUnsupervised Machine Translation