Ensemble Self-Training for Unsupervised Machine Translation
We present an ensemble-driven self-training framework for unsupervised neural machine translation (UNMT). Starting from a primary language pair, we train multiple UNMT models that share the same translation task but differ in an auxiliary language, inducing structured diversity across models. We then generate pseudo-translations for the primary pair using token-level ensemble decoding, averaging model predictions in both directions. These ensemble outputs are used as synthetic parallel data to further train each model, allowing the models to improve via shared supervision. At deployment time, we select a single model by validation performance, preserving single-model inference cost. Experiments show statistically significant improvements over single-model UNMT baselines, with mean gains of 1.7 chrF when translating from English and 0.67 chrF when translating into English.
Code (0)
등록된 구현이 없습니다.
Tasks
Unsupervised Machine TranslationSimilar Papers 제목 키워드 기반
The LMU Munich Unsupervised Machine Translation System for WMT19
We describe LMU Munich{'}s machine translation system for German→Czech translation which was used to participate in the WMT19 shared task on unsupervised news translation. We train our model using monolingual data only…
DenoisingLanguage ModelingLanguage ModellingMachine Translation+3Exploiting Image Translations via Ensemble Self-Supervised Learning for Unsupervised Domain Adaptation
We introduce an unsupervised domain adaption (UDA) strategy that combines multiple image translations, ensemble learning and self-supervised learning in one coherent approach. We focus on one of the standard tasks of UDA…
Domain AdaptationDomain GeneralizationEnsemble LearningImage-to-Image Translation+6Self-Training for Unsupervised Neural Machine Translation in Unbalanced Training Data Scenarios
Unsupervised neural machine translation (UNMT) that relies solely on massive monolingual corpora has achieved remarkable results in several translation tasks. However, in real-world scenarios, massive monolingual corpora…
Machine TranslationTranslationThe NiuTrans Machine Translation Systems for WMT19
This paper described NiuTrans neural machine translation systems for the WMT 2019 news translation tasks. We participated in 13 translation directions, including 11 supervised tasks, namely EN↔{ZH, DE, RU, KK, LT}, GU→EN…
Knowledge DistillationMachine TranslationNMTReranking+1The LMU Munich System for the WMT 2020 Unsupervised Machine Translation Shared Task
This paper describes the submission of LMU Munich to the WMT 2020 unsupervised shared task, in two language directions, German<->Upper Sorbian. Our core unsupervised neural machine translation (UNMT) system follows the s…
Machine TranslationText GenerationTranslationUnsupervised Machine Translation