Unpaired Image-to-Image Translation with Content Preserving Perspective: A Review
Image-to-image translation (I2I) transforms an image from a source domain to a target domain while preserving source content. Most computer vision applications are in the field of image-to-image translation, such as style transfer, image segmentation, and photo enhancement. The degree of preservation of the content of the source images in the translation process can be different according to the problem and the intended application. From this point of view, in this paper, we divide the different tasks in the field of image-to-image translation into three categories: Fully Content preserving, Partially Content preserving, and Non-Content preserving. We present different tasks, datasets, methods, results of methods for these three categories in this paper. We make a categorization for I2I methods based on the architecture of different models and study each category separately. In addition, we introduce well-known evaluation criteria in the I2I translation field. Specifically, nearly 70 different I2I models were analyzed, and more than 10 quantitative evaluation metrics and 30 distinct tasks and datasets relevant to the I2I translation problem were both introduced and assessed. Translating from simulation to real images could be well viewed as an application of fully content preserving or partially content preserving unsupervised image-to-image translation methods. So, we provide a benchmark for Sim-to-Real translation, which can be used to evaluate different methods. In general, we conclude that because of the different extent of the obligation to preserving content in various applications, it is better to consider this issue in choosing a suitable I2I model for a specific application.
Code (0)
등록된 구현이 없습니다.
Tasks
Image SegmentationImage-to-Image TranslationSemantic SegmentationStyle TransferTranslationUnsupervised Image-To-Image TranslationSimilar Papers 제목 키워드 기반
Content-Preserving Unpaired Translation from Simulated to Realistic Ultrasound Images
Interactive simulation of ultrasound imaging greatly facilitates sonography training. Although ray-tracing based methods have shown promising results, obtaining realistic images requires substantial modeling effort and m…
DisentanglementTranslationUnpaired Image-to-Image Translation for Segmentation and Signal Unmixing
This work introduces Ui2i, a novel model for unpaired image-to-image translation, trained on content-wise unpaired datasets to enable style transfer across domains while preserving content. Building on CycleGAN, Ui2i inc…
Domain AdaptationImage-to-Image TranslationNuclear SegmentationStyle Transfer+1Unpaired Image-to-Image Translation via Latent Energy Transport
Image-to-image translation aims to preserve source contents while translating to discriminative target styles between two visual domains. Most works apply adversarial learning in the ambient image space, which could be c…
Image ReconstructionImage-to-Image TranslationTranslationPRISM: Distribution-Gated Flow Matching for Controllable Unpaired Image Translation
Unpaired image-to-image translation must decide, per image, what to change and what to preserve without paired supervision. Many diffusion-based unpaired translators control preservation through a single global noise or …
Image-to-Image TranslationUnpaired Image-to-Image Translation With Shortest Path Regularization
Unpaired image-to-image translation aims to learn proper mappings that can map images from one domain to another domain while preserving the content of the input image. However, with large enough capacities, the netw…
Image-to-Image TranslationTranslation