Learning image-to-image translation using paired and unpaired training samples
Image-to-image translation is a general name for a task where an image from one domain is converted to a corresponding image in another domain, given sufficient training data. Traditionally different approaches have been proposed depending on whether aligned image pairs or two sets of (unaligned) examples from both domains are available for training. While paired training samples might be difficult to obtain, the unpaired setup leads to a highly under-constrained problem and inferior results. In this paper, we propose a new general purpose image-to-image translation model that is able to utilize both paired and unpaired training data simultaneously. We compare our method with two strong baselines and obtain both qualitatively and quantitatively improved results. Our model outperforms the baselines also in the case of purely paired and unpaired training data. To our knowledge, this is the first work to consider such hybrid setup in image-to-image translation.
Code (1)
Tasks
Image-to-Image TranslationTranslationSimilar Papers 제목 키워드 기반
ITTR: Unpaired Image-to-Image Translation with Transformers
Unpaired image-to-image translation is to translate an image from a source domain to a target domain without paired training data. By utilizing CNN in extracting local semantics, various techniques have been developed to…
Image-to-Image TranslationTranslationUnpaired Translation from Semantic Label Maps to Images by Leveraging Domain-Specific Simulations
Photorealistic image generation from simulated label maps are necessitated in several contexts, such as for medical training in virtual reality. With conventional deep learning methods, this task requires images that are…
Contrastive LearningImage GenerationTranslationExtremely Weak Supervised Image-to-Image Translation for Semantic Segmentation
Recent advances in generative models and adversarial training have led to a flourishing image-to-image (I2I) translation literature. The current I2I translation approaches require training images from the two domains tha…
Image SegmentationImage-to-Image TranslationSemantic SegmentationTranslationUnpaired Image-to-Image Translation via Neural Schrödinger Bridge
Diffusion models are a powerful class of generative models which simulate stochastic differential equations (SDEs) to generate data from noise. While diffusion models have achieved remarkable progress, they have limitati…
Image-to-Image TranslationTranslationAptSim2Real: Approximately-Paired Sim-to-Real Image Translation
Advancements in graphics technology has increased the use of simulated data for training machine learning models. However, the simulated data often differs from real-world data, creating a distribution gap that can decre…
Image-to-Image TranslationTranslation