Iterative Back-Translation for Neural Machine Translation
We present iterative back-translation, a method for generating increasingly better synthetic parallel data from monolingual data to train neural machine translation systems. Our proposed method is very simple yet effective and highly applicable in practice. We demonstrate improvements in neural machine translation quality in both high and low resourced scenarios, including the best reported BLEU scores for the WMT 2017 German↔English tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Iterative Batch Back-Translation for Neural Machine Translation: A Conceptual Model
An effective method to generate a large number of parallel sentences for training improved neural machine translation (NMT) systems is the use of back-translations of the target-side monolingual data. Recently, iterative…
Machine TranslationNMTTranslationDo all Roads Lead to Rome? Understanding the Role of Initialization in Iterative Back-Translation
Back-translation provides a simple yet effective approach to exploit monolingual corpora in Neural Machine Translation (NMT). Its iterative variant, where two opposite NMT models are jointly trained by alternately using …
AllMachine TranslationNMTTranslation+1Dual Reconstruction: a Unifying Objective for Semi-Supervised Neural Machine Translation
While Iterative Back-Translation and Dual Learning effectively incorporate monolingual training data in neural machine translation, they use different objectives and heuristic gradient approximation strategies, and have …
Machine TranslationTranslationA Hybrid Approach for Improved Low Resource Neural Machine Translation using Monolingual Data
Many language pairs are low resource, meaning the amount and/or quality of available parallel data is not sufficient to train a neural machine translation (NMT) model which can reach an acceptable standard of accuracy. M…
Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationNMT+2Quick Back-Translation for Unsupervised Machine Translation
The field of unsupervised machine translation has seen significant advancement from the marriage of the Transformer and the back-translation algorithm. The Transformer is a powerful generative model, and back-translation…
DecoderMachine TranslationTranslationUnsupervised Machine Translation