A Style-aware Discriminator for Controllable Image Translation
Current image-to-image translations do not control the output domain beyond the classes used during training, nor do they interpolate between different domains well, leading to implausible results. This limitation largely arises because labels do not consider the semantic distance. To mitigate such problems, we propose a style-aware discriminator that acts as a critic as well as a style encoder to provide conditions. The style-aware discriminator learns a controllable style space using prototype-based self-supervised learning and simultaneously guides the generator. Experiments on multiple datasets verify that the proposed model outperforms current state-of-the-art image-to-image translation methods. In contrast with current methods, the proposed approach supports various applications, including style interpolation, content transplantation, and local image translation.
Code (1)
Tasks
Image ManipulationImage-to-Image TranslationMultimodal Unsupervised Image-To-Image TranslationUnsupervised Image-To-Image TranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
EDIT: Exemplar-Domain Aware Image-to-Image Translation
Image-to-image translation is to convert an image of the certain style to another of the target style with the content preserved. A desired translator should be capable to generate diverse results in a controllable (many…
Generative Adversarial NetworkImage-to-Image TranslationTranslationRemote Sensing Image Translation via Style-Based Recalibration Module and Improved Style Discriminator
Existing remote sensing change detection methods are heavily affected by seasonal variation. Since vegetation colors are different between winter and summer, such variations are inclined to be falsely detected as changes…
Change DetectionTranslationGIRAFFE HD: A High-Resolution 3D-aware Generative Model
3D-aware generative models have shown that the introduction of 3D information can lead to more controllable image generation. In particular, the current state-of-the-art model GIRAFFE can control each object's rotation, …
DisentanglementImage GenerationTranslationVocal Bursts Intensity PredictionUnified Generative Adversarial Networks for Controllable Image-to-Image Translation
We propose a unified Generative Adversarial Network (GAN) for controllable image-to-image translation, i.e., transferring an image from a source to a target domain guided by controllable structures. In addition to condit…
Facial Expression TranslationGenerative Adversarial NetworkGesture-to-Gesture TranslationImage Generation+2Panoramic Image-to-Image Translation
In this paper, we tackle the challenging task of Panoramic Image-to-Image translation (Pano-I2I) for the first time. This task is difficult due to the geometric distortion of panoramic images and the lack of a panoramic …
Image-to-Image TranslationTranslation