Automatic Construction of Morphologically Motivated Translation Models for Highly Inflected, Low-Resource Languages
Statistical Machine Translation (SMT) of highly inflected, low-resource languages suffers from the problem of low bitext availability, which is exacerbated by large inflectional paradigms. When translating into English, rich source inflections have a high chance of being poorly estimated or out-of-vocabulary (OOV). We present a source language-agnostic system for automatically constructing phrase pairs from foreign-language inflections and their morphological analyses using manually constructed datasets, including Wiktionary. We then demonstrate the utility of these phrase tables in improving translation into English from Finnish, Czech, and Turkish in simulated low-resource settings, finding substantial gains in translation quality. We report up to +2.58 BLEU in a simulated low-resource setting and +1.65 BLEU in a moderateresource setting. We release our morphologically-motivated translation models, with tens of thousands of inflections in each of 8 languages.
Code (1)
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Morphological and Language-Agnostic Word Segmentation for NMT
The state of the art of handling rich morphology in neural machine translation (NMT) is to break word forms into subword units, so that the overall vocabulary size of these units fits the practical limits given by the NM…
GPUMachine TranslationNMTTranslationTranslating Between Morphologically Rich Languages: An Arabic-to-Turkish Machine Translation System
This paper introduces the work on building a machine translation system for Arabic-to-Turkish in the news domain. Our work includes collecting parallel datasets in several ways for a new and low-resourced language pair, …
Machine TranslationTranslationLinguistically-Motivated Yorùbá-English Machine Translation
Translating between languages where certain features are marked morphologically in one but absent or marked contextually in the other is an important test case for machine translation. When translating into English which…
Machine TranslationNMTTranslationRobust Word Vectors: Context-Informed Embeddings for Noisy Texts
We suggest a new language-independent architecture of robust word vectors (RoVe). It is designed to alleviate the issue of typos, which are common in almost any user-generated content, and hinder automatic text processin…
Morphological AnalysisWord EmbeddingsLinguistically Motivated Vocabulary Reduction for Neural Machine Translation from Turkish to English
The necessity of using a fixed-size word vocabulary in order to control the model complexity in state-of-the-art neural machine translation (NMT) systems is an important bottleneck on performance, especially for morpholo…
Machine TranslationMorphological AnalysisNMTTranslation