A Domain Gap Aware Generative Adversarial Network for Multi-domain Image Translation
Recent image-to-image translation models have shown great success in mapping local textures between two domains. Existing approaches rely on a cycle-consistency constraint that supervises the generators to learn an inverse mapping. However, learning the inverse mapping introduces extra trainable parameters and it is unable to learn the inverse mapping for some domains. As a result, they are ineffective in the scenarios where (i) multiple visual image domains are involved; (ii) both structure and texture transformations are required; and (iii) semantic consistency is preserved. To solve these challenges, the paper proposes a unified model to translate images across multiple domains with significant domain gaps. Unlike previous models that constrain the generators with the ubiquitous cycle-consistency constraint to achieve the content similarity, the proposed model employs a perceptual self-regularization constraint. With a single unified generator, the model can maintain consistency over the global shapes as well as the local texture information across multiple domains. Extensive qualitative and quantitative evaluations demonstrate the effectiveness and superior performance over state-of-the-art models. It is more effective in representing shape deformation in challenging mappings with significant dataset variation across multiple domains.
Code (0)
등록된 구현이 없습니다.
Tasks
Generative Adversarial NetworkImage-to-Image TranslationTranslationSimilar Papers 제목 키워드 기반
Semantic-Aware Generative Adversarial Nets for Unsupervised Domain Adaptation in Chest X-ray Segmentation
In spite of the compelling achievements that deep neural networks (DNNs) have made in medical image computing, these deep models often suffer from degraded performance when being applied to new test datasets with domain …
Domain AdaptationSegmentationTransfer LearningUnsupervised Domain AdaptationShape-aware Generative Adversarial Networks for Attribute Transfer
Generative adversarial networks (GANs) have been successfully applied to transfer visual attributes in many domains, including that of human face images. This success is partly attributable to the facts that human faces …
AttributeImage-to-Image TranslationTransfer LearningTranslationFACL-Attack: Frequency-Aware Contrastive Learning for Transferable Adversarial Attacks
Deep neural networks are known to be vulnerable to security risks due to the inherent transferable nature of adversarial examples. Despite the success of recent generative model-based attacks demonstrating strong transfe…
Contrastive LearningChannel-Aware Domain-Adaptive Generative Adversarial Network for Robust Speech Recognition
While pre-trained automatic speech recognition (ASR) systems demonstrate impressive performance on matched domains, their performance often degrades when confronted with channel mismatch stemming from unseen recording en…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Generative Adversarial NetworkRobust Speech Recognition+2EDIT: Exemplar-Domain Aware Image-to-Image Translation
Image-to-image translation is to convert an image of the certain style to another of the target style with the content preserved. A desired translator should be capable to generate diverse results in a controllable (many…
Generative Adversarial NetworkImage-to-Image TranslationTranslation