Complementary Strategies for Low Resourced Morphological Modeling
Morphologically rich languages are challenging for natural language processing tasks due to data sparsity. This can be addressed either by introducing out-of-context morphological knowledge, or by developing machine learning architectures that specifically target data sparsity and/or morphological information. We find these approaches to complement each other in a morphological paradigm modeling task in Modern Standard Arabic, which, in addition to being morphologically complex, features ubiquitous ambiguity, exacerbating sparsity with noise. Given a small number of out-of-context rules describing closed class morphology, we combine them with word embeddings leveraging subword strings and noise reduction techniques. The combination outperforms both approaches individually by about 20{\%} absolute. While morphological resources already exist for Modern Standard Arabic, our results inform how comparable resources might be constructed for non-standard dialects or any morphologically rich, low resourced language, given scarcity of time and funding.
Code (0)
등록된 구현이 없습니다.
Tasks
Morphological AnalysisWord EmbeddingsSimilar Papers 제목 키워드 기반
Using Resource-Rich Languages to Improve Morphological Analysis of Under-Resourced Languages
The world-wide proliferation of digital communications has created the need for language and speech processing systems for under-resourced languages. Developing such systems is challenging if only small data sets are ava…
LemmatizationMorphological AnalysisSubword Tokenization Strategies for Kurdish Word Embeddings
We investigate tokenization strategies for Kurdish word embeddings by comparing word-level, morpheme-based, and BPE approaches on morphological similarity preservation tasks. We develop a BiLSTM-CRF morphological segment…
Evaluating Word Embeddings in Extremely Under-Resourced Languages: A Case Study in Bribri
Word embeddings are critical for numerous NLP tasks but their evaluation in actual under-resourced settings needs further examination. This paper presents a case study in Bribri, a Chibchan language from Costa Rica. Four…
Odd One OutWord EmbeddingsTraining and Adapting Multilingual NMT for Less-resourced and Morphologically Rich Languages
Shona spaCy: A Morphological Analyzer for an Under-Resourced Bantu Language
Despite rapid advances in multilingual natural language processing (NLP), the Bantu language Shona remains under-served in terms of morphological analysis and language-aware tools. This paper presents Shona spaCy, an ope…