Character Alignment in Morphologically Complex Translation Sets for Related Languages
For languages with complex morphology, word-to-word translation is a task with various potential applications, for example, in information retrieval, language instruction, and dictionary creation, as well as in machine translation. In this paper, we confine ourselves to the subtask of character alignment for the particular case of families of related languages with very few resources for most or all members. There are many such families; we focus on the subgroup of Semitic languages spoken in Ethiopia and Eritrea. We begin with an adaptation of the familiar alignment algorithms behind statistical machine translation, modifying them as appropriate for our task. We show how character alignment can reveal morphological, phonological, and orthographic correspondences among related languages.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalMachine TranslationRetrievalTranslationWord TranslationSimilar Papers 제목 키워드 기반
Word Representation Models for Morphologically Rich Languages in Neural Machine Translation
Dealing with the complex word forms in morphologically rich languages is an open problem in language processing, and is particularly important in translation. In contrast to most modern neural systems of translation, whi…
Hard AttentionMachine TranslationTranslationUzbek-English and Turkish-English Morpheme Alignment Corpora
Morphologically-rich languages pose problems for machine translation (MT) systems, including word-alignment errors, data sparsity and multiple affixes. Current alignment models at word-level do not distinguish words and …
Machine TranslationTranslationWord AlignmentTailoring Neural Architectures for Translating from Morphologically Rich Languages
A morphologically complex word (MCW) is a hierarchical constituent with meaning-preserving subunits, so word-based models which rely on surface forms might not be powerful enough to translate such structures. When transl…
DecoderMachine TranslationNMTSentence+1Patching Leaks in the Charformer for Efficient Character-Level Generation
Character-based representations have important advantages over subword-based ones for morphologically rich languages. They come with increased robustness to noisy input and do not need a separate tokenization step. Howev…
DecoderNMTTranslationLinguistically Motivated Vocabulary Reduction for Neural Machine Translation from Turkish to English
The necessity of using a fixed-size word vocabulary in order to control the model complexity in state-of-the-art neural machine translation (NMT) systems is an important bottleneck on performance, especially for morpholo…
Machine TranslationMorphological AnalysisNMTTranslation