Domain Adaptation for NMT via Filtered Iterative Back-Translation
Domain-specific Neural Machine Translation (NMT) model can provide improved performance, however, it is difficult to always access a domain-specific parallel corpus. Iterative Back-Translation can be used for fine-tuning an NMT model for a domain even if only a monolingual domain corpus is available. The quality of synthetic parallel corpora in terms of closeness to in-domain sentences can play an important role in the performance of the translation model. Recent works have shown that filtering at different stages of the back translation and weighting the sentences can provide state-of-the-art performance. In comparison, in this work, we observe that a simpler filtering approach based on a domain classifier, applied only to the pseudo-training data can consistently perform better, providing performance gains of 1.40, 1.82 and 0.76 in terms of BLEU score for Medical, Law and IT in one direction, and 1.28, 1.60 and 1.60 in the other direction in low resource scenario over competitive baselines. In the high resource scenario, our approach is at par with competitive baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationMachine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
Iterative Constrained Back-Translation for Unsupervised Domain Adaptation of Machine Translation
Back-translation has been proven to be effective in unsupervised domain adaptation of neural machine translation (NMT). However, the existing back-translation methods mainly improve domain adaptability by generating in-d…
Domain AdaptationMachine TranslationNMTSentence+3Iterative Domain-Repaired Back-Translation
In this paper, we focus on the domain-specific translation with low resources, where in-domain parallel corpora are scarce or nonexistent. One common and effective strategy for this case is exploiting in-domain monolingu…
Domain AdaptationNMTTranslationExploiting Language Relatedness in Machine Translation Through Domain Adaptation Techniques
One of the significant challenges of Machine Translation (MT) is the scarcity of large amounts of data, mainly parallel sentence aligned corpora. If the evaluation is as rigorous as resource-rich languages, both Neural M…
Domain AdaptationLanguage ModellingMachine TranslationNMT+2Dynamic Data Selection and Weighting for Iterative Back-Translation
Back-translation has proven to be an effective method to utilize monolingual data in neural machine translation (NMT), and iteratively conducting back-translation can further improve the model performance. Selecting whic…
Domain AdaptationMachine TranslationNMTSentence+1A Simple Baseline to Semi-Supervised Domain Adaptation for Machine Translation
State-of-the-art neural machine translation (NMT) systems are data-hungry and perform poorly on new domains with no supervised data. As data collection is expensive and infeasible in many cases, domain adaptation methods…
Domain AdaptationLanguage ModelingLanguage ModellingMachine Translation+4