AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networks
State-of-the-art methods in image-to-image translation are capable of learning a mapping from a source domain to a target domain with unpaired image data. Though the existing methods have achieved promising results, they still produce visual artifacts, being able to translate low-level information but not high-level semantics of input images. One possible reason is that generators do not have the ability to perceive the most discriminative parts between the source and target domains, thus making the generated images low quality. In this paper, we propose a new Attention-Guided Generative Adversarial Networks (AttentionGAN) for the unpaired image-to-image translation task. AttentionGAN can identify the most discriminative foreground objects and minimize the change of the background. The attention-guided generators in AttentionGAN are able to produce attention masks, and then fuse the generation output with the attention masks to obtain high-quality target images. Accordingly, we also design a novel attention-guided discriminator which only considers attended regions. Extensive experiments are conducted on several generative tasks with eight public datasets, demonstrating that the proposed method is effective to generate sharper and more realistic images compared with existing competitive models. The code is available at https://github.com/Ha0Tang/AttentionGAN.
Code (3)
Tasks
Image-to-Image TranslationTranslationSimilar Papers 제목 키워드 기반
Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation
The state-of-the-art approaches in Generative Adversarial Networks (GANs) are able to learn a mapping function from one image domain to another with unpaired image data. However, these methods often produce artifacts and…
Generative Adversarial NetworkImage-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationShow, Attend and Translate: Unpaired Multi-Domain Image-to-Image Translation with Visual Attention
Recently unpaired multi-domain image-to-image translation has attracted great interests and obtained remarkable progress, where a label vector is utilized to indicate multi-domain information. In this paper, we propose S…
AttributeGenerative Adversarial NetworkImage-to-Image TranslationTranslationITTR: Unpaired Image-to-Image Translation with Transformers
Unpaired image-to-image translation is to translate an image from a source domain to a target domain without paired training data. By utilizing CNN in extracting local semantics, various techniques have been developed to…
Image-to-Image TranslationTranslationAugmented Cyclic Consistency Regularization for Unpaired Image-to-Image Translation
Unpaired image-to-image (I2I) translation has received considerable attention in pattern recognition and computer vision because of recent advancements in generative adversarial networks (GANs). However, due to the lack …
Data AugmentationImage-to-Image TranslationTranslationMixerGAN: An MLP-Based Architecture for Unpaired Image-to-Image Translation
While attention-based transformer networks achieve unparalleled success in nearly all language tasks, the large number of tokens (pixels) found in images coupled with the quadratic activation memory usage makes them proh…
Image-to-Image TranslationTranslation