Unaligned Image-to-Image Translation by Learning to Reweight
Unsupervised image-to-image translation aims at learning the mapping from the source to target domain without using paired images for training. An essential yet restrictive assumption for unsupervised image translation is that the two domains are aligned, e.g., for the selfie2anime task, the anime (selfie) domain must contain only anime (selfie) face images that can be translated to some images in the other domain. Collecting aligned domains can be laborious and needs lots of attention. In this paper, we consider the task of image translation between two unaligned domains, which may arise for various possible reasons. To solve this problem, we propose to select images based on importance reweighting and develop a method to learn the weights and perform translation simultaneously and automatically. We compare the proposed method with state-of-the-art image translation approaches and present qualitative and quantitative results on different tasks with unaligned domains. Extensive empirical evidence demonstrates the usefulness of the proposed problem formulation and the superiority of our method.
Code (1)
Tasks
Image-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationSimilar Papers 제목 키워드 기반
Image Manipulation with Perceptual Discriminators
Systems that perform image manipulation using deep convolutional networks have achieved remarkable realism. Perceptual losses and losses based on adversarial discriminators are the two main classes of learning objectives…
Image ManipulationTranslationFrom Design Draft to Real Attire: Unaligned Fashion Image Translation
Fashion manipulation has attracted growing interest due to its great application value, which inspires many researches towards fashion images. However, little attention has been paid to fashion design draft. In this pape…
TranslationLearning Symmetry Consistent Deep CNNs for Face Completion
Deep convolutional networks (CNNs) have achieved great success in face completion to generate plausible facial structures. These methods, however, are limited in maintaining global consistency among face components and r…
Face RecognitionFacial InpaintingLearning image-to-image translation using paired and unpaired training samples
Image-to-image translation is a general name for a task where an image from one domain is converted to a corresponding image in another domain, given sufficient training data. Traditionally different approaches have been…
Image-to-Image TranslationTranslationVTON-IT: Virtual Try-On using Image Translation
Virtual Try-On (trying clothes virtually) is a promising application of the Generative Adversarial Network (GAN). However, it is an arduous task to transfer the desired clothing item onto the corresponding regions of a h…
Generative Adversarial NetworkSemantic SegmentationTranslationVirtual Try-on