A Deep Generative Framework for Paraphrase Generation
Paraphrase generation is an important problem in NLP, especially in question answering, information retrieval, information extraction, conversation systems, to name a few. In this paper, we address the problem of generating paraphrases automatically. Our proposed method is based on a combination of deep generative models (VAE) with sequence-to-sequence models (LSTM) to generate paraphrases, given an input sentence. Traditional VAEs when combined with recurrent neural networks can generate free text but they are not suitable for paraphrase generation for a given sentence. We address this problem by conditioning the both, encoder and decoder sides of VAE, on the original sentence, so that it can generate the given sentence's paraphrases. Unlike most existing models, our model is simple, modular and can generate multiple paraphrases, for a given sentence. Quantitative evaluation of the proposed method on a benchmark paraphrase dataset demonstrates its efficacy, and its performance improvement over the state-of-the-art methods by a significant margin, whereas qualitative human evaluation indicate that the generated paraphrases are well-formed, grammatically correct, and are relevant to the input sentence. Furthermore, we evaluate our method on a newly released question paraphrase dataset, and establish a new baseline for future research.
Code (1)
Tasks
DecoderInformation RetrievalParaphrase GenerationQuestion AnsweringRetrievalSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DivGAN: Towards Diverse Paraphrase Generation via Diversified Generative Adversarial Network
Paraphrases refer to texts that convey the same meaning with different expression forms. Traditional seq2seq-based models on paraphrase generation mainly focus on the fidelity while ignoring the diversity of outputs. In …
DiversityGenerative Adversarial NetworkParaphrase GenerationParaphrase Augmented Task-Oriented Dialog Generation
Neural generative models have achieved promising performance on dialog generation tasks if given a huge data set. However, the lack of high-quality dialog data and the expensive data annotation process greatly limit thei…
Data AugmentationResponse GenerationTowards Diverse Paraphrase Generation Using Multi-Class Wasserstein GAN
Paraphrase generation is an important and challenging natural language processing (NLP) task. In this work, we propose a deep generative model to generate paraphrase with diversity. Our model is based on an encoder-decod…
DecoderDiversityParaphrase GenerationSentenceVector-Quantized Prompt Learning for Paraphrase Generation
Deep generative modeling of natural languages has achieved many successes, such as producing fluent sentences and translating from one language into another. However, the development of generative modeling techniques for…
DiversityParaphrase GenerationPrompt LearningExploring Diverse Expressions for Paraphrase Generation
Paraphrasing plays an important role in various natural language processing (NLP) tasks, such as question answering, information retrieval and sentence simplification. Recently, neural generative models have shown promis…
DiversityInformation RetrievalParaphrase GenerationQuestion Answering+4