When and Why is Unsupervised Neural Machine Translation Useless?
This paper studies the practicality of the current state-of-the-art unsupervised methods in neural machine translation (NMT). In ten translation tasks with various data settings, we analyze the conditions under which the unsupervised methods fail to produce reasonable translations. We show that their performance is severely affected by linguistic dissimilarity and domain mismatch between source and target monolingual data. Such conditions are common for low-resource language pairs, where unsupervised learning works poorly. In all of our experiments, supervised and semi-supervised baselines with 50k-sentence bilingual data outperform the best unsupervised results. Our analyses pinpoint the limits of the current unsupervised NMT and also suggest immediate research directions.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationNMTSentenceTranslationSimilar Papers 제목 키워드 기반
Gumbel-Attention for Multi-modal Machine Translation
Multi-modal machine translation (MMT) improves translation quality by introducing visual information. However, the existing MMT model ignores the problem that the image will bring information irrelevant to the text, caus…
Machine TranslationMultimodal Machine TranslationTranslationStudy on Unsupervised Statistical Machine Translation for Backtranslation
Machine Translation systems have drastically improved over the years for several language pairs. Monolingual data is often used to generate synthetic sentences to augment the training data which has shown to improve the …
Machine TranslationTranslationUnsupervised Machine TranslationTarget Foresight Based Attention for Neural Machine Translation
In neural machine translation, an attention model is used to identify the aligned source words for a target word (target foresight word) in order to select translation context, but it does not make use of any information…
Language ModelingLanguage ModellingMachine TranslationTranslationSAO WMT19 Test Suite: Machine Translation of Audit Reports
This paper describes a machine translation test set of documents from the auditing domain and its use as one of the "test suites" in the WMT19 News Translation Task for translation directions involving Czech, English and…
Machine TranslationTranslationSAO WMT19 Test Suite: Machine Translation of Audit Reports
This paper describes a machine translation test set of documents from the auditing domain and its use as one of the {``}test suites{''} in the WMT19 News Translation Task for translation directions involving Czech, Engli…
Machine TranslationTranslation