Contrastive Learning for Unsupervised Image-to-Image Translation
Image-to-image translation aims to learn a mapping between different groups of visually distinguishable images. While recent methods have shown impressive ability to change even intricate appearance of images, they still rely on domain labels in training a model to distinguish between distinct visual features. Such dependency on labels often significantly limits the scope of applications since consistent and high-quality labels are expensive. Instead, we wish to capture visual features from images themselves and apply them to enable realistic translation without human-generated labels. To this end, we propose an unsupervised image-to-image translation method based on contrastive learning. The key idea is to learn a discriminator that differentiates between distinctive styles and let the discriminator supervise a generator to transfer those styles across images. During training, we randomly sample a pair of images and train the generator to change the appearance of one towards another while keeping the original structure. Experimental results show that our method outperforms the leading unsupervised baselines in terms of visual quality and translation accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningImage-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationSimilar Papers 제목 키워드 기반
Dual Contrastive Learning for Unsupervised Image-to-Image Translation
Unsupervised image-to-image translation tasks aim to find a mapping between a source domain X and a target domain Y from unpaired training data. Contrastive learning for Unpaired image-to-image Translation (CUT) yields s…
Contrastive LearningImage-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationMulti-cropping Contrastive Learning and Domain Consistency for Unsupervised Image-to-Image Translation
Recently, unsupervised image-to-image translation methods based on contrastive learning have achieved state-of-the-art results in many tasks. However, in the previous works, the negatives are sampled from the input image…
Contrastive LearningData AugmentationImage-to-Image TranslationTranslation+1Enhanced Unsupervised Image-to-Image Translation Using Contrastive Learning and Histogram of Oriented Gradients
Image-to-Image Translation is a vital area of computer vision that focuses on transforming images from one visual domain to another while preserving their core content and structure. However, this field faces two major c…
Contrastive LearningImage GenerationImage-to-Image TranslationTranslation+1Unsupervised Contrastive Photo-to-Caricature Translation based on Auto-distortion
Photo-to-caricature translation aims to synthesize the caricature as a rendered image exaggerating the features through sketching, pencil strokes, or other artistic drawings. Style rendering and geometry deformation are …
CaricaturePhoto-To-Caricature TranslationTranslationAnatomical Conditioning for Contrastive Unpaired Image-to-Image Translation of Optical Coherence Tomography Images
For a unified analysis of medical images from different modalities, data harmonization using image-to-image (I2I) translation is desired. We study this problem employing an optical coherence tomography (OCT) data set of …
Contrastive LearningDecoderDomain AdaptationImage-to-Image Translation+2