Iterative Batch Back-Translation for Neural Machine Translation: A Conceptual Model
An effective method to generate a large number of parallel sentences for training improved neural machine translation (NMT) systems is the use of back-translations of the target-side monolingual data. Recently, iterative back-translation has been shown to outperform standard back-translation albeit on some language pairs. This work proposes the iterative batch back-translation that is aimed at enhancing the standard iterative back-translation and enabling the efficient utilization of more monolingual data. After each iteration, improved back-translations of new sentences are added to the parallel data that will be used to train the final forward model. The work presents a conceptual model of the proposed approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
Do all Roads Lead to Rome? Understanding the Role of Initialization in Iterative Back-Translation
Back-translation provides a simple yet effective approach to exploit monolingual corpora in Neural Machine Translation (NMT). Its iterative variant, where two opposite NMT models are jointly trained by alternately using …
AllMachine TranslationNMTTranslation+1Iterative Back-Translation for Neural Machine Translation
We present iterative back-translation, a method for generating increasingly better synthetic parallel data from monolingual data to train neural machine translation systems. Our proposed method is very simple yet effecti…
Machine TranslationTranslationDual Reconstruction: a Unifying Objective for Semi-Supervised Neural Machine Translation
While Iterative Back-Translation and Dual Learning effectively incorporate monolingual training data in neural machine translation, they use different objectives and heuristic gradient approximation strategies, and have …
Machine TranslationTranslationA Hybrid Approach for Improved Low Resource Neural Machine Translation using Monolingual Data
Many language pairs are low resource, meaning the amount and/or quality of available parallel data is not sufficient to train a neural machine translation (NMT) model which can reach an acceptable standard of accuracy. M…
Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationNMT+2Quick Back-Translation for Unsupervised Machine Translation
The field of unsupervised machine translation has seen significant advancement from the marriage of the Transformer and the back-translation algorithm. The Transformer is a powerful generative model, and back-translation…
DecoderMachine TranslationTranslationUnsupervised Machine Translation