Efficient Neural Machine Translation for Low-Resource Languages via Exploiting Related Languages
A large percentage of the world{'}s population speaks a language of the Indian subcontinent, comprising languages from both Indo-Aryan (e.g. Hindi, Punjabi, Gujarati, etc.) and Dravidian (e.g. Tamil, Telugu, Malayalam, etc.) families. A universal characteristic of Indian languages is their complex morphology, which, when combined with the general lack of sufficient quantities of high-quality parallel data, can make developing machine translation (MT) systems for these languages difficult. Neural Machine Translation (NMT) is a rapidly advancing MT paradigm and has shown promising results for many language pairs, especially in large training data scenarios. Since the condition of large parallel corpora is not met for Indian-English language pairs, we present our efforts towards building efficient NMT systems between Indian languages (specifically Indo-Aryan languages) and English via efficiently exploiting parallel data from the related languages. We propose a technique called Unified Transliteration and Subword Segmentation to leverage language similarity while exploiting parallel data from related language pairs. We also propose a Multilingual Transfer Learning technique to leverage parallel data from multiple related languages to assist translation for low resource language pair of interest. Our experiments demonstrate an overall average improvement of 5 BLEU points over the standard Transformer-based NMT baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationNMTTransfer LearningTranslationTransliterationSimilar Papers 제목 키워드 기반
A Survey on Low-Resource Neural Machine Translation
Neural approaches have achieved state-of-the-art accuracy on machine translation but suffer from the high cost of collecting large scale parallel data. Thus, a lot of research has been conducted for neural machine transl…
Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationLow Resource NMTMachine Translation+3Exploiting Language Relatedness in Machine Translation Through Domain Adaptation Techniques
One of the significant challenges of Machine Translation (MT) is the scarcity of large amounts of data, mainly parallel sentence aligned corpora. If the evaluation is as rigorous as resource-rich languages, both Neural M…
Domain AdaptationLanguage ModellingMachine TranslationNMT+2Improving Statistical Machine Translation for a Resource-Poor Language Using Related Resource-Rich Languages
We propose a novel language-independent approach for improving machine translation for resource-poor languages by exploiting their similarity to resource-rich ones. More precisely, we improve the translation from a resou…
Machine TranslationTranslationTransliterationAdapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data
The scarcity of parallel data is a major obstacle for training high-quality machine translation systems for low-resource languages. Fortunately, some low-resource languages are linguistically related or similar to high-r…
DenoisingMachine TranslationNMTTranslationA Survey of Orthographic Information in Machine Translation
Machine translation is one of the applications of natural language processing which has been explored in different languages. Recently researchers started paying attention towards machine translation for resource-poor la…
Bilingual Lexicon InductionMachine TranslationSurveyTranslation