Wavelet-based Unsupervised Label-to-Image Translation
Semantic Image Synthesis (SIS) is a subclass of image-to-image translation where a semantic layout is used to generate a photorealistic image. State-of-the-art conditional Generative Adversarial Networks (GANs) need a huge amount of paired data to accomplish this task while generic unpaired image-to-image translation frameworks underperform in comparison, because they color-code semantic layouts and learn correspondences in appearance instead of semantic content. Starting from the assumption that a high quality generated image should be segmented back to its semantic layout, we propose a new Unsupervised paradigm for SIS (USIS) that makes use of a self-supervised segmentation loss and whole image wavelet based discrimination. Furthermore, in order to match the high-frequency distribution of real images, a novel generator architecture in the wavelet domain is proposed. We test our methodology on 3 challenging datasets and demonstrate its ability to bridge the performance gap between paired and unpaired models.
Code (1)
Tasks
Image GenerationImage-to-Image TranslationMultimodal Unsupervised Image-To-Image TranslationTranslationUnsupervised Image-To-Image TranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
USIS: Unsupervised Semantic Image Synthesis
Semantic Image Synthesis (SIS) is a subclass of image-to-image translation where a photorealistic image is synthesized from a segmentation mask. SIS has mostly been addressed as a supervised problem. However, state-of-th…
Image GenerationImage-to-Image TranslationTranslationDual-Tree Wavelet Scattering Network with Parametric Log Transformation for Object Classification
We introduce a ScatterNet that uses a parametric log transformation with Dual-Tree complex wavelets to extract translation invariant representations from a multi-resolution image. The parametric transformation aids the O…
Computational EfficiencyGeneral ClassificationTranslationRethinking the Truly Unsupervised Image-to-Image Translation
Every recent image-to-image translation model inherently requires either image-level (i.e. input-output pairs) or set-level (i.e. domain labels) supervision. However, even set-level supervision can be a severe bottleneck…
Image-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationContrastive Learning for Unsupervised Image-to-Image Translation
Image-to-image translation aims to learn a mapping between different groups of visually distinguishable images. While recent methods have shown impressive ability to change even intricate appearance of images, they still…
Contrastive LearningImage-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationSemantically Consistent Image-to-Image Translation for Unsupervised Domain Adaptation
Unsupervised Domain Adaptation (UDA) aims to adapt models trained on a source domain to a new target domain where no labelled data is available. In this work, we investigate the problem of UDA from a synthetic computer-g…
Domain AdaptationImage-to-Image TranslationSemantic SegmentationTranslation+1