Study on Unsupervised Statistical Machine Translation for Backtranslation
Machine Translation systems have drastically improved over the years for several language pairs. Monolingual data is often used to generate synthetic sentences to augment the training data which has shown to improve the performance of machine translation models. In our paper, we make use of an Unsupervised Statistical Machine Translation (USMT) to generate synthetic sentences. Our study compares the performance improvements in Neural Machine Translation model when using synthetic sentences from supervised and unsupervised Machine Translation models. Our approach of using USMT for backtranslation shows promise in low resource conditions and achieves an improvement of 3.2 BLEU score over the Neural Machine Translation model.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationUnsupervised Machine TranslationSimilar Papers 제목 키워드 기반
The LMU Munich System for the WMT 2020 Unsupervised Machine Translation Shared Task
This paper describes the submission of LMU Munich to the WMT 2020 unsupervised shared task, in two language directions, German<->Upper Sorbian. Our core unsupervised neural machine translation (UNMT) system follows the s…
Machine TranslationText GenerationTranslationUnsupervised Machine TranslationUnsupervised Statistical Machine Translation
While modern machine translation has relied on large parallel corpora, a recent line of work has managed to train Neural Machine Translation (NMT) systems from monolingual corpora only (Artetxe et al., 2018c; Lample et a…
Language ModelingLanguage ModellingMachine TranslationNMT+2Unsupervised Neural Machine Translation with Generative Language Models Only
We show how to derive state-of-the-art unsupervised neural machine translation systems from generatively pre-trained language models. Our method consists of three steps: few-shot amplification, distillation, and backtran…
Language ModelingLanguage ModellingMachine TranslationTranslationThe LMU Munich Unsupervised Machine Translation Systems
We describe LMU Munich{'}s unsupervised machine translation systems for English↔German translation. These systems were used to participate in the WMT18 news translation shared task and more specifically, for the unsupe…
DenoisingLanguage ModelingLanguage ModellingMachine Translation+3Integrating Unsupervised Data Generation into Self-Supervised Neural Machine Translation for Low-Resource Languages
For most language combinations, parallel data is either scarce or simply unavailable. To address this, unsupervised machine translation (UMT) exploits large amounts of monolingual data by using synthetic data generation …
DenoisingMachine TranslationNMTSynthetic Data Generation+2