Few-Shot Unsupervised Image-to-Image Translation
Unsupervised image-to-image translation methods learn to map images in a given class to an analogous image in a different class, drawing on unstructured (non-registered) datasets of images. While remarkably successful, current methods require access to many images in both source and destination classes at training time. We argue this greatly limits their use. Drawing inspiration from the human capability of picking up the essence of a novel object from a small number of examples and generalizing from there, we seek a few-shot, unsupervised image-to-image translation algorithm that works on previously unseen target classes that are specified, at test time, only by a few example images. Our model achieves this few-shot generation capability by coupling an adversarial training scheme with a novel network design. Through extensive experimental validation and comparisons to several baseline methods on benchmark datasets, we verify the effectiveness of the proposed framework. Our implementation and datasets are available at https://github.com/NVlabs/FUNIT .
Code (10)
Tasks
Image-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationSimilar Papers 제목 키워드 기반
COCO-FUNIT: Few-Shot Unsupervised Image Translation with a Content Conditioned Style Encoder
Unsupervised image-to-image translation intends to learn a mapping of an image in a given domain to an analogous image in a different domain, without explicit supervision of the mapping. Few-shot unsupervised image-to-im…
Image-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationToward Zero-Shot Unsupervised Image-to-Image Translation
Recent studies have shown remarkable success in unsupervised image-to-image translation. However, if there has no access to enough images in target classes, learning a mapping from source classes to the target classes al…
AttributeImage-to-Image TranslationTranslationUnsupervised Image-To-Image Translation+2ZstGAN: An Adversarial Approach for Unsupervised Zero-Shot Image-to-Image Translation
Image-to-image translation models have shown remarkable ability on transferring images among different domains. Most of existing work follows the setting that the source domain and target domain keep the same at training…
AttributeImage GenerationImage-to-Image TranslationTranslation+1One-Shot Unsupervised Cross Domain Translation
Given a single image x from domain A and a set of images from domain B, our task is to generate the analogous of x in B. We argue that this task could be a key AI capability that underlines the ability of cognitive agent…
TranslationUnsupervised Image-To-Image TranslationZero-Shot LearningFew-Shot Unsupervised Image-to-Image Translation on complex scenes
Unsupervised image-to-image translation methods have received a lot of attention in the last few years. Multiple techniques emerged tackling the initial challenge from different perspectives. Some focus on learning as mu…
Image-to-Image TranslationObjectobject-detectionObject Detection+2