Target-Side Augmentation for Document-Level Machine Translation
Document-level machine translation faces the challenge of data sparsity due to its long input length and a small amount of training data, increasing the risk of learning spurious patterns. To address this challenge, we propose a target-side augmentation method, introducing a data augmentation (DA) model to generate many potential translations for each source document. Learning on these wider range translations, an MT model can learn a smoothed distribution, thereby reducing the risk of data sparsity. We demonstrate that the DA model, which estimates the posterior distribution, largely improves the MT performance, outperforming the previous best system by 2.30 s-BLEU on News and achieving new state-of-the-art on News and Europarl benchmarks. Our code is available at https://github.com/baoguangsheng/target-side-augmentation.
Code (1)
Tasks
Data AugmentationDocument Level Machine TranslationMachine TranslationTranslationSimilar Papers 제목 키워드 기반
Importance-Aware Data Augmentation for Document-Level Neural Machine Translation
Document-level neural machine translation (DocNMT) aims to generate translations that are both coherent and cohesive, in contrast to its sentence-level counterpart. However, due to its longer input length and limited ava…
Data AugmentationMachine TranslationSentenceTranslationDocument-level Event Factuality Identification via Machine Reading Comprehension Frameworks with Transfer Learning
Document-level Event Factuality Identification (DEFI) predicts the factuality of a specific event based on a document from which the event can be derived, which is a fundamental and crucial task in Natural Language Proce…
Data AugmentationMachine Reading ComprehensionMultiple-choiceReading Comprehension+4Promoting Target Data in Context-aware Neural Machine Translation
Standard context-aware neural machine translation (NMT) typically relies on parallel document-level data, exploiting both source and target contexts. Concatenation-based approaches in particular, still a strong baseline …
Machine TranslationNMTTranslationDocument Context Neural Machine Translation with Memory Networks
We present a document-level neural machine translation model which takes both source and target document context into account using memory networks. We model the problem as a structured prediction problem with interdepen…
Machine TranslationStructured PredictionTranslationThe ADAPT Centre’s Neural MT Systems for the WAT 2020 Document-Level Translation Task
In this paper we describe the ADAPT Centre’s submissions to the WAT 2020 document-level Business Scene Dialogue (BSD) Translation task. We only consider translating from Japanese to English for this task and we use the M…
Data AugmentationMachine TranslationTranslation