paper-with-me

Papers

Unsupervised Neural Machine Translation for Low-Resource Domains via Meta-Learning

2020-10-18 · ACL 2021 5 · Cheonbok Park, Yunwon Tae, Taehee Kim, Soyoung Yang, Mohammad Azam Khan, Eunjeong Park, Jaegul Choo

Unsupervised machine translation, which utilizes unpaired monolingual corpora as training data, has achieved comparable performance against supervised machine translation. However, it still suffers from data-scarce domains. To address this issue, this paper presents a novel meta-learning algorithm for unsupervised neural machine translation (UNMT) that trains the model to adapt to another domain by utilizing only a small amount of training data. We assume that domain-general knowledge is a significant factor in handling data-scarce domains. Hence, we extend the meta-learning algorithm, which utilizes knowledge learned from high-resource domains, to boost the performance of low-resource UNMT. Our model surpasses a transfer learning-based approach by up to 2-4 BLEU scores. Extensive experimental results show that our proposed algorithm is pertinent for fast adaptation and consistently outperforms other baseline models.

📄 PDF Abstract BibTeX arXiv:2010.09046

Code (0)

등록된 구현이 없습니다.

Tasks

General KnowledgeMachine TranslationMeta-LearningTransfer LearningTranslationUnsupervised Machine Translation

Similar Papers 제목 키워드 기반

Meta-Curriculum Learning for Domain Adaptation in Neural Machine Translation

2021-03-03 · Runzhe Zhan, Xuebo Liu, Derek F. Wong, Lidia S. Chao

Meta-learning has been sufficiently validated to be beneficial for low-resource neural machine translation (NMT). However, we find that meta-trained NMT fails to improve the translation performance of the domain unseen a…

Domain AdaptationLow Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine Translation+3

Unsupervised Source Hierarchies for Low-Resource Neural Machine Translation

2018-07-01 · WS 2018 7 · Anna Currey, Kenneth Heafield

Incorporating source syntactic information into neural machine translation (NMT) has recently proven successful (Eriguchi et al., 2016; Luong et al., 2016). However, this is generally done using an outside parser to synt…

Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationNatural Language Inference+4

POMP: Probability-driven Meta-graph Prompter for LLMs in Low-resource Unsupervised Neural Machine Translation

2024-01-11 · Shilong Pan, Zhiliang Tian, Liang Ding, Zhen Huang 외

Low-resource languages (LRLs) face challenges in supervised neural machine translation due to limited parallel data, prompting research into unsupervised methods. Unsupervised neural machine translation (UNMT) methods, i…

In-Context LearningMachine TranslationNMTTransfer Learning+1

When Does Unsupervised Machine Translation Work?

2020-04-12 · WMT (EMNLP) 2020 11 · Kelly Marchisio, Kevin Duh, Philipp Koehn

Despite the reported success of unsupervised machine translation (MT), the field has yet to examine the conditions under which these methods succeed, and where they fail. We conduct an extensive empirical evaluation of u…

Machine TranslationTranslationUnsupervised Machine Translation

Unsupervised Machine Translation in Real-World Scenarios

2022-06-01 · LREC 2022 6 · Ona de Gibert Bonet, Iakes Goenaga, Jordi Armengol-Estapé, Olatz Perez-de-Viñaspre 외

In this work, we present the work that has been carried on in the MT4All CEF project and the resources that it has generated by leveraging recent research carried out in the field of unsupervised learning. In the course …

Machine TranslationTranslationUnsupervised Machine Translation