Language Generation with Recurrent Generative Adversarial Networks without Pre-training
Generative Adversarial Networks (GANs) have shown great promise recently in image generation. Training GANs for language generation has proven to be more difficult, because of the non-differentiable nature of generating text with recurrent neural networks. Consequently, past work has either resorted to pre-training with maximum-likelihood or used convolutional networks for generation. In this work, we show that recurrent neural networks can be trained to generate text with GANs from scratch using curriculum learning, by slowly teaching the model to generate sequences of increasing and variable length. We empirically show that our approach vastly improves the quality of generated sequences compared to a convolutional baseline.
Code (3)
Tasks
Text GenerationSimilar Papers 제목 키워드 기반
GANs & Reels: Creating Irish Music using a Generative Adversarial Network
In this paper we present a method for algorithmic melody generation using a generative adversarial network without recurrent components. Music generation has been successfully done using recurrent neural networks, where …
Generative Adversarial NetworkMusic GenerationText Generation Based on Generative Adversarial Nets with Latent Variable
In this paper, we propose a model using generative adversarial net (GAN) to generate realistic text. Instead of using standard GAN, we combine variational autoencoder (VAE) with generative adversarial net. The use of hig…
Language ModelingLanguage ModellingText GenerationNon-Sequential Melody Generation
In this paper we present a method for algorithmic melody generation using a generative adversarial network without recurrent components. Music generation has been successfully done using recurrent neural networks, where …
Generative Adversarial NetworkMusic GenerationComparision Of Adversarial And Non-Adversarial LSTM Music Generative Models
Algorithmic music composition is a way of composing musical pieces with minimal to no human intervention. While recurrent neural networks are traditionally applied to many sequence-to-sequence prediction tasks, including…
Music GenerationRecurrent Deconvolutional Generative Adversarial Networks with Application to Text Guided Video Generation
This paper proposes a novel model for video generation and especially makes the attempt to deal with the problem of video generation from text descriptions, i.e., synthesizing realistic videos conditioned on given texts.…
Generative Adversarial NetworkVideo ClassificationVideo GenerationVideo Prediction