Text to Image Synthesis Using Generative Adversarial Networks
Generating images from natural language is one of the primary applications of recent conditional generative models. Besides testing our ability to model conditional, highly dimensional distributions, text to image synthesis has many exciting and practical applications such as photo editing or computer-aided content creation. Recent progress has been made using Generative Adversarial Networks (GANs). This material starts with a gentle introduction to these topics and discusses the existent state of the art models. Moreover, I propose Wasserstein GAN-CLS, a new model for conditional image generation based on the Wasserstein distance which offers guarantees of stability. Then, I show how the novel loss function of Wasserstein GAN-CLS can be used in a Conditional Progressive Growing GAN. In combination with the proposed loss, the model boosts by 7.07% the best Inception Score (on the Caltech birds dataset) of the models which use only the sentence-level visual semantics. The only model which performs better than the Conditional Wasserstein Progressive Growing GAN is the recently proposed AttnGAN which uses word-level visual semantics as well.
Code (0)
등록된 구현이 없습니다.
Tasks
Conditional Image GenerationImage GenerationSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
An Introduction to Image Synthesis with Generative Adversarial Nets
There has been a drastic growth of research in Generative Adversarial Nets (GANs) in the past few years. Proposed in 2014, GAN has been applied to various applications such as computer vision and natural language process…
Image GenerationImage-to-Image TranslationTranslationStackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networks
Although Generative Adversarial Networks (GANs) have shown remarkable success in various tasks, they still face challenges in generating high quality images. In this paper, we propose Stacked Generative Adversarial Netwo…
Generative Adversarial NetworkImage GenerationText-to-Image GenerationTexture Synthesis with Spatial Generative Adversarial Networks
Generative adversarial networks (GANs) are a recent approach to train generative models of data, which have been shown to work particularly well on image data. In the current paper we introduce a new model for texture sy…
Texture SynthesisPrecomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks
This paper proposes Markovian Generative Adversarial Networks (MGANs), a method for training generative neural networks for efficient texture synthesis. While deep neural network approaches have recently demonstrated rem…
Style TransferTexture SynthesisAdversarial Text-to-Image Synthesis: A Review
With the advent of generative adversarial networks, synthesizing images from textual descriptions has recently become an active research area. It is a flexible and intuitive way for conditional image generation with sign…
Adversarial TextConditional Image GenerationDiversityImage Generation