RelGAN: Relational Generative Adversarial Networks for Text Generation
Generative adversarial networks (GANs) have achieved great success at generating realistic images. However, the text generation still remains a challenging task for modern GAN architectures. In this work, we propose RelGAN, a new GAN architecture for text generation, consisting of three main components: a relational memory based generator for the long-distance dependency modeling, the Gumbel-Softmax relaxation for training GANs on discrete data, and multiple embedded representations in the discriminator to provide a more informative signal for the generator updates. Our experiments show that RelGAN outperforms current state-of-the-art models in terms of sample quality and diversity, and we also reveal via ablation studies that each component of RelGAN contributes critically to its performance improvements. Moreover, a key advantage of our method, that distinguishes it from other GANs, is the ability to control the trade-off between sample quality and diversity via the use of a single adjustable parameter. Finally, RelGAN is the first architecture that makes GANs with Gumbel-Softmax relaxation succeed in generating realistic text.
Code (1)
Tasks
DiversityText GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improvement in Machine Translation with Generative Adversarial Networks
In this paper, we explore machine translation improvement via Generative Adversarial Network (GAN) architecture. We take inspiration from RelGAN, a model for text generation, and NMT-GAN, an adversarial machine translati…
Generative Adversarial NetworkMachine TranslationNMTSentence+2Controlled Text Generation with Adversarial Learning
In recent years, generative adversarial networks (GANs) have started to attain promising results also in natural language generation. However, the existing models have paid limited attention to the semantic coherence of …
SentenceText GenerationHouse-GAN: Relational Generative Adversarial Networks for Graph-constrained House Layout Generation
This paper proposes a novel graph-constrained generative adversarial network, whose generator and discriminator are built upon relational architecture. The main idea is to encode the constraint into the graph structure o…
DiversityGenerative Adversarial NetworkLayout GenerationMAGIC: Multimodal relAtional Graph adversarIal inferenCe for Diverse and Unpaired Text-based Image Captioning
Text-based image captioning (TextCap) requires simultaneous comprehension of visual content and reading the text of images to generate a natural language description. Although a task can teach machines to understand the …
Caption GenerationDescriptiveDiversityGenerative Adversarial Network+2Recurrent Relational Memory Network for Unsupervised Image Captioning
Unsupervised image captioning with no annotations is an emerging challenge in computer vision, where the existing arts usually adopt GAN (Generative Adversarial Networks) models. In this paper, we propose a novel memory-…
Computational EfficiencyImage CaptioningRelational ReasoningSentence