ParaBank: Monolingual Bitext Generation and Sentential Paraphrasing via Lexically-constrained Neural Machine Translation
We present ParaBank, a large-scale English paraphrase dataset that surpasses prior work in both quantity and quality. Following the approach of ParaNMT, we train a Czech-English neural machine translation (NMT) system to generate novel paraphrases of English reference sentences. By adding lexical constraints to the NMT decoding procedure, however, we are able to produce multiple high-quality sentential paraphrases per source sentence, yielding an English paraphrase resource with more than 4 billion generated tokens and exhibiting greater lexical diversity. Using human judgments, we also demonstrate that ParaBank's paraphrases improve over ParaNMT on both semantic similarity and fluency. Finally, we use ParaBank to train a monolingual NMT model with the same support for lexically-constrained decoding for sentence rewriting tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityMachine TranslationNMTSemantic SimilaritySemantic Textual SimilaritySentenceSentence ReWritingTranslationSimilar Papers 제목 키워드 기반
Large-Scale, Diverse, Paraphrastic Bitexts via Sampling and Clustering
Producing diverse paraphrases of a sentence is a challenging task. Natural paraphrase corpora are scarce and limited, while existing large-scale resources are automatically generated via back-translation and rely on beam…
ClusteringDiversitySentenceTranslationParaZh-22M: A Large-Scale Chinese Parabank via Machine Translation
Paraphrasing, i.e., restating the same meaning in different ways, is an important data augmentation approach for natural language processing (NLP). Zhang et al. (2019b) propose to extract sentence-level paraphrases from …
Data AugmentationMachine TranslationNatural Language UnderstandingSentence+1Unsupervised Paraphrasing without Translation
Paraphrasing exemplifies the ability to abstract semantic content from surface forms. Recent work on automatic paraphrasing is dominated by methods leveraging Machine Translation (MT) as an intermediate step. This contra…
Machine TranslationParaphrase IdentificationTranslationExploiting Monolingual Data at Scale for Neural Machine Translation
While target-side monolingual data has been proven to be very useful to improve neural machine translation (briefly, NMT) through back translation, source-side monolingual data is not well investigated. In this work, we …
Machine TranslationNMTTranslationAUGVIC: Exploiting BiText Vicinity for Low-Resource NMT
The success of Neural Machine Translation (NMT) largely depends on the availability of large bitext training corpora. Due to the lack of such large corpora in low-resource language pairs, NMT systems often exhibit poor p…
Data AugmentationLow Resource NMTMachine TranslationNMT+1