Generating Text through Adversarial Training using Skip-Thought Vectors
GANs have been shown to perform exceedingly well on tasks pertaining to image generation and style transfer. In the field of language modelling, word embeddings such as GLoVe and word2vec are state-of-the-art methods for applying neural network models on textual data. Attempts have been made to utilize GANs with word embeddings for text generation. This study presents an approach to text generation using Skip-Thought sentence embeddings with GANs based on gradient penalty functions and f-measures. The proposed architecture aims to reproduce writing style in the generated text by modelling the way of expression at a sentence level across all the works of an author. Extensive experiments were run in different embedding settings on a variety of tasks including conditional text generation and language generation. The model outperforms baseline text generation networks across several automated evaluation metrics like BLEU-n, METEOR and ROUGE. Further, wide applicability and effectiveness in real life tasks are demonstrated through human judgement scores.
Code (1)
Tasks
Conditional Text GenerationLanguage ModellingSentenceSentence EmbeddingsStyle TransferText GenerationWord EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Skip-Thought GAN: Generating Text through Adversarial Training using Skip-Thought Vectors
In the past few years, various advancements have been made in generative models owing to the formulation of Generative Adversarial Networks (GANs). GANs have been shown to perform exceedingly well on a wide variety of ta…
Image GenerationSentenceSentence EmbeddingsStyle Transfer+2GAN with Skip Patch Discriminator for Biological Electron Microscopy Image Generation
Generating realistic electron microscopy (EM) images has been a challenging problem due to their complex global and local structures. Isola et al. proposed pix2pix, a conditional Generative Adversarial Network (GAN), for…
Generative Adversarial NetworkImage GenerationImage-to-Image TranslationTranslationAdvSGM: Differentially Private Graph Learning via Adversarial Skip-gram Model
The skip-gram model (SGM), which employs a neural network to generate node vectors, serves as the basis for numerous popular graph embedding techniques. However, since the training datasets contain sensitive linkage info…
Graph EmbeddingGraph LearningSkip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNets
Skip connections are an essential component of current state-of-the-art deep neural networks (DNNs) such as ResNet, WideResNet, DenseNet, and ResNeXt. Despite their huge success in building deeper and more powerful DNNs,…
Stylized Projected GAN: A Novel Architecture for Fast and Realistic Image Generation
Generative Adversarial Networks are used for generating the data using a generator and a discriminator, GANs usually produce high-quality images, but training GANs in an adversarial setting is a difficult task. GANs requ…
Image GenerationTransfer Learning