Unpaired Multi-Domain Image Generation via Regularized Conditional GANs
In this paper, we study the problem of multi-domain image generation, the goal of which is to generate pairs of corresponding images from different domains. With the recent development in generative models, image generation has achieved great progress and has been applied to various computer vision tasks. However, multi-domain image generation may not achieve the desired performance due to the difficulty of learning the correspondence of different domain images, especially when the information of paired samples is not given. To tackle this problem, we propose Regularized Conditional GAN (RegCGAN) which is capable of learning to generate corresponding images in the absence of paired training data. RegCGAN is based on the conditional GAN, and we introduce two regularizers to guide the model to learn the corresponding semantics of different domains. We evaluate the proposed model on several tasks for which paired training data is not given, including the generation of edges and photos, the generation of faces with different attributes, etc. The experimental results show that our model can successfully generate corresponding images for all these tasks, while outperforms the baseline methods. We also introduce an approach of applying RegCGAN to unsupervised domain adaptation.
Code (1)
Tasks
Domain AdaptationImage GenerationUnsupervised Domain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Regularized Distribution Matching Distillation for One-step Unpaired Image-to-Image Translation
Diffusion distillation methods aim to compress the diffusion models into efficient one-step generators while trying to preserve quality. Among them, Distribution Matching Distillation (DMD) offers a suitable framework fo…
Image-to-Image TranslationTranslationDecay2Distill: Leveraging spatial perturbation and regularization for self-supervised image denoising
Unpaired image denoising has achieved promising development over the last few years. Regardless of the performance, methods tend to heavily rely on underlying noise properties or any assumption which is not always practi…
DenoisingImage DenoisingU-DuDoNet: Unpaired dual-domain network for CT metal artifact reduction
Recently, both supervised and unsupervised deep learning methods have been widely applied on the CT metal artifact reduction (MAR) task. Supervised methods such as Dual Domain Network (Du-DoNet) work well on simulation d…
DisentanglementMetal Artifact ReductionPaired and Unpaired Image to Image Translation using Generative Adversarial Networks
Image to image translation is an active area of research in the field of computer vision, enabling the generation of new images with different styles, textures, or resolutions while preserving their characteristic proper…
Image-to-Image TranslationTranslationDual Generator Generative Adversarial Networks for Multi-Domain Image-to-Image Translation
State-of-the-art methods for image-to-image translation with Generative Adversarial Networks (GANs) can learn a mapping from one domain to another domain using unpaired image data. However, these methods require the trai…
Generative Adversarial NetworkImage-to-Image TranslationTranslation