Improved Lexically Constrained Decoding for Translation and Monolingual Rewriting
Lexically-constrained sequence decoding allows for explicit positive or negative phrase-based constraints to be placed on target output strings in generation tasks such as machine translation or monolingual text rewriting. We describe vectorized dynamic beam allocation, which extends work in lexically-constrained decoding to work with batching, leading to a five-fold improvement in throughput when working with positive constraints. Faster decoding enables faster exploration of constraint strategies: we illustrate this via data augmentation experiments with a monolingual rewriter applied to the tasks of natural language inference, question answering and machine translation, showing improvements in all three.
Code (1)
Tasks
Data AugmentationMachine TranslationNatural Language InferenceQuestion AnsweringTranslationSimilar Papers 제목 키워드 기반
ParaBank: Monolingual Bitext Generation and Sentential Paraphrasing via Lexically-constrained Neural Machine Translation
We present ParaBank, a large-scale English paraphrase dataset that surpasses prior work in both quantity and quality. Following the approach of ParaNMT, we train a Czech-English neural machine translation (NMT) system to…
DiversityMachine TranslationNMTSemantic Similarity+4Negative Lexically Constrained Decoding for Paraphrase Generation
Paraphrase generation can be regarded as monolingual translation. Unlike bilingual machine translation, paraphrase generation rewrites only a limited portion of an input sentence. Hence, previous methods based on machine…
Machine TranslationParaphrase GenerationSentenceText Simplification+1Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine Translation
The end-to-end nature of neural machine translation (NMT) removes many ways of manually guiding the translation process that were available in older paradigms. Recent work, however, has introduced a new capability: lexic…
Machine TranslationNMTTranslationAccurate Online Posterior Alignments for Principled Lexically-Constrained Decoding
Online alignment in machine translation refers to the task of aligning a target word to a source word when the target sequence has only been partially decoded. Good online alignments facilitate important applications suc…
Machine TranslationTranslationAccurate Online Posterior Alignments for Principled Lexically-Constrained Decoding
Online alignment in machine translation refers to the task of aligning a target word to a source word when the target sequence has only been partially decoded. Good online alignments facilitate important applications suc…
Machine TranslationTranslation