Unsupervised Neural Machine Translation for Low-Resource Domains via Meta-Learning
Unsupervised machine translation, which utilizes unpaired monolingual corpora as training data, has achieved comparable performance against supervised machine translation. However, it still suffers from data-scarce domains. To address this issue, this paper presents a novel meta-learning algorithm for unsupervised neural machine translation (UNMT) that trains the model to adapt to another domain by utilizing only a small amount of training data. We assume that domain-general knowledge is a significant factor in handling data-scarce domains. Hence, we extend the meta-learning algorithm, which utilizes knowledge learned from high-resource domains, to boost the performance of low-resource UNMT. Our model surpasses a transfer learning-based approach by up to 2-4 BLEU scores. Extensive experimental results show that our proposed algorithm is pertinent for fast adaptation and consistently outperforms other baseline models.
Code (0)
등록된 구현이 없습니다.
Tasks
General KnowledgeMachine TranslationMeta-LearningTransfer LearningTranslationUnsupervised Machine TranslationSimilar Papers 제목 키워드 기반
Meta-Curriculum Learning for Domain Adaptation in Neural Machine Translation
Meta-learning has been sufficiently validated to be beneficial for low-resource neural machine translation (NMT). However, we find that meta-trained NMT fails to improve the translation performance of the domain unseen a…
Domain AdaptationLow Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine Translation+3Unsupervised Source Hierarchies for Low-Resource Neural Machine Translation
Incorporating source syntactic information into neural machine translation (NMT) has recently proven successful (Eriguchi et al., 2016; Luong et al., 2016). However, this is generally done using an outside parser to synt…
Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationNatural Language Inference+4POMP: Probability-driven Meta-graph Prompter for LLMs in Low-resource Unsupervised Neural Machine Translation
Low-resource languages (LRLs) face challenges in supervised neural machine translation due to limited parallel data, prompting research into unsupervised methods. Unsupervised neural machine translation (UNMT) methods, i…
In-Context LearningMachine TranslationNMTTransfer Learning+1When Does Unsupervised Machine Translation Work?
Despite the reported success of unsupervised machine translation (MT), the field has yet to examine the conditions under which these methods succeed, and where they fail. We conduct an extensive empirical evaluation of u…
Machine TranslationTranslationUnsupervised Machine TranslationUnsupervised Machine Translation in Real-World Scenarios
In this work, we present the work that has been carried on in the MT4All CEF project and the resources that it has generated by leveraging recent research carried out in the field of unsupervised learning. In the course …
Machine TranslationTranslationUnsupervised Machine Translation