Instance Weighting for Neural Machine Translation Domain Adaptation
Instance weighting has been widely applied to phrase-based machine translation domain adaptation. However, it is challenging to be applied to Neural Machine Translation (NMT) directly, because NMT is not a linear model. In this paper, two instance weighting technologies, i.e., sentence weighting and domain weighting with a dynamic weight learning strategy, are proposed for NMT domain adaptation. Empirical results on the IWSLT English-German/French tasks show that the proposed methods can substantially improve NMT performance by up to 2.7-6.7 BLEU points, outperforming the existing baselines by up to 1.6-3.6 BLEU points.
Code (1)
Tasks
Domain AdaptationMachine TranslationNMTSentenceTranslationSimilar Papers 제목 키워드 기반
Cost Weighting for Neural Machine Translation Domain Adaptation
In this paper, we propose a new domain adaptation technique for neural machine translation called cost weighting, which is appropriate for adaptation scenarios in which a small in-domain data set and a large general-doma…
Domain AdaptationMachine TranslationTranslationMulti-Domain Adaptation in Neural Machine Translation with Dynamic Sampling Strategies
Building effective Neural Machine Translation models often implies accommodating diverse sets of heterogeneous data so as to optimize performance for the domain(s) of interest. Such multi-source / multi-domain adaptation…
Domain AdaptationMachine TranslationTranslationUnsupervised Domain AdaptationSentence Weighting for Neural Machine Translation Domain Adaptation
In this paper, we propose a new sentence weighting method for the domain adaptation of neural machine translation. We introduce a domain similarity metric to evaluate the relevance between a sentence and an available ent…
Domain AdaptationLanguage ModelingLanguage ModellingMachine Translation+2Revisiting Simple Domain Adaptation Methods in Unsupervised Neural Machine Translation
Domain adaptation has been well-studied in supervised neural machine translation (SNMT). However, it has not been well-studied for unsupervised neural machine translation (UNMT), although UNMT has recently achieved remar…
Domain AdaptationMachine TranslationTranslationDynamic Data Selection and Weighting for Iterative Back-Translation
Back-translation has proven to be an effective method to utilize monolingual data in neural machine translation (NMT), and iteratively conducting back-translation can further improve the model performance. Selecting whic…
Domain AdaptationMachine TranslationNMTSentence+1