Data-adaptive Transfer Learning for Low-resource Translation: A Case Study in Haitian
Multilingual transfer techniques often improve low-resource machine translation (MT). Many of these techniques are applied without considering data characteristics. We show in the context of Haitian-to-English translation that transfer effectiveness is correlated with amount of training data and relationships between knowledge-sharing languages. Our experiments suggest that beyond a threshold of authentic data, back-translation augmentation methods are counterproductive, while cross-lingual transfer during training is preferred. We complement this finding by contributing a rule-based French-Haitian orthographic and syntactic engine and a novel method for phonological embedding. When used with multilingual techniques, orthographic transformation significantly improves performance over conventional methods, and phonological transfer greatly improves performance in Jamaican MT.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual TransferMachine TranslationTransfer LearningTranslationSimilar Papers 제목 키워드 기반
Data-adaptive Transfer Learning for Translation: A Case Study in Haitian and Jamaican
Multilingual transfer techniques often improve low-resource machine translation (MT). Many of these techniques are applied without considering data characteristics. We show in the context of Haitian-to-English translatio…
Cross-Lingual TransferMachine TranslationTransfer LearningTranslationTaking Actions Separately: A Bidirectionally-Adaptive Transfer Learning Method for Low-Resource Neural Machine Translation
Training Neural Machine Translation (NMT) models suffers from sparse parallel data, in the infrequent translation scenarios towards low-resource source languages. The existing solutions primarily concentrate on the utili…
Generative Adversarial NetworkLanguage ModelingLanguage ModellingLow Resource Neural Machine Translation+8Collective Wisdom: Improving Low-resource Neural Machine Translation using Adaptive Knowledge Distillation
Scarcity of parallel sentence-pairs poses a significant hurdle for training high-quality Neural Machine Translation (NMT) models in bilingually low-resource scenarios. A standard approach is transfer learning, which invo…
Knowledge DistillationLow Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine Translation+4Neural Machine Translation in Low-Resource Setting: a Case Study in English-Marathi Pair
In this paper and we explore different techniques of overcoming the challenges of low-resource in Neural Machine Translation (NMT) and specifically focusing on the case of English-Marathi NMT. NMT systems require a large…
Machine TranslationNMTTransfer LearningTranslationTenTrans Multilingual Low-Resource Translation System for WMT21 Indo-European Languages Task
This paper describes TenTrans’ submission to WMT21 Multilingual Low-Resource Translation shared task for the Romance language pairs. This task focuses on improving translation quality from Catalan to Occitan, Romanian an…
Transfer LearningTranslation