Segmentation Guided Image-to-Image Translation with Adversarial Networks
Recently image-to-image translation has received increasing attention, which aims to map images in one domain to another specific one. Existing methods mainly solve this task via a deep generative model, and focus on exploring the relationship between different domains. However, these methods neglect to utilize higher-level and instance-specific information to guide the training process, leading to a great deal of unrealistic generated images of low quality. Existing methods also lack of spatial controllability during translation. To address these challenge, we propose a novel Segmentation Guided Generative Adversarial Networks (SGGAN), which leverages semantic segmentation to further boost the generation performance and provide spatial mapping. In particular, a segmentor network is designed to impose semantic information on the generated images. Experimental results on multi-domain face image translation task empirically demonstrate our ability of the spatial modification and our superiority in image quality over several state-of-the-art methods.
Code (1)
Tasks
Image-to-Image TranslationSegmentationSemantic SegmentationTranslationSimilar Papers 제목 키워드 기반
3D Segmentation Guided Style-based Generative Adversarial Networks for PET Synthesis
Potential radioactive hazards in full-dose positron emission tomography (PET) imaging remain a concern, whereas the quality of low-dose images is never desirable for clinical use. So it is of great interest to translate …
Generative Adversarial NetworkTranslationUnified Generative Adversarial Networks for Controllable Image-to-Image Translation
We propose a unified Generative Adversarial Network (GAN) for controllable image-to-image translation, i.e., transferring an image from a source to a target domain guided by controllable structures. In addition to condit…
Facial Expression TranslationGenerative Adversarial NetworkGesture-to-Gesture TranslationImage Generation+2Semi-Supervised Image-to-Image Translation
Image-to-image translation is a long-established and a difficult problem in computer vision. In this paper we propose an adversarial based model for image-to-image translation. The regular deep neural-network based metho…
Generative Adversarial NetworkImage SegmentationImage-to-Image TranslationMultimodal Unsupervised Image-To-Image Translation+4Lung image segmentation by generative adversarial networks
Lung image segmentation plays an important role in computer-aid pulmonary diseases diagnosis and treatment. This paper proposed a lung image segmentation method by generative adversarial networks. We employed a variety o…
Image SegmentationSegmentationSemantic SegmentationTranslationMulti-resolution Guided 3D GANs for Medical Image Translation
Medical image translation is the process of converting from one imaging modality to another, in order to reduce the need for multiple image acquisitions from the same patient. This can enhance the efficiency of treatment…
Generative Adversarial NetworkImage Quality AssessmentTranslation