UzbekStemmer: Development of a Rule-Based Stemming Algorithm for Uzbek Language
In this paper we present a rule-based stemming algorithm for the Uzbek language. Uzbek is an agglutinative language, so many words are formed by adding suffixes, and the number of suffixes is also large. For this reason, it is difficult to find a stem of words. The methodology is proposed for doing the stemming of the Uzbek words with an affix stripping approach whereas not including any database of the normal word forms of the Uzbek language. Word affixes are classified into fifteen classes and designed as finite state machines (FSMs) for each class according to morphological rules. We created fifteen FSMs and linked them together to create the Basic FSM. A lexicon of affixes in XML format was created and a stemming application for Uzbek words has been developed based on the FSMs.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
UzbekTagger: The rule-based POS tagger for Uzbek language
This research paper presents a part-of-speech (POS) annotated dataset and tagger tool for the low-resource Uzbek language. The dataset includes 12 tags, which were used to develop a rule-based POS-tagger tool. The corpus…
Language ModelingLanguage ModellingMachine TranslationPOS+6Uzbek affix finite state machine for stemming
This work presents a morphological analyzer for the Uzbek language using a finite state machine. The proposed methodology is a morphologic analysis of Uzbek words by using an affix striping to find a root and without inc…
Morphological AnalysisDevelopment of a rule-based lemmatization algorithm through Finite State Machine for Uzbek language
Lemmatization is one of the core concepts in natural language processing, thus creating a lemmatization tool is an important task. This paper discusses the construction of a lemmatization algorithm for the Uzbek language…
LEMMALemmatizationBBPOS: BERT-based Part-of-Speech Tagging for Uzbek
This paper advances NLP research for the low-resource Uzbek language by evaluating two previously untested monolingual Uzbek BERT models on the part-of-speech (POS) tagging task and introducing the first publicly availab…
Part-Of-Speech TaggingPOSPOS TaggingSensitivityUzMorphAnalyser: A Morphological Analysis Model for the Uzbek Language Using Inflectional Endings
As Uzbek language is agglutinative, has many morphological features which words formed by combining root and affixes. Affixes play an important role in the morphological analysis of words, by adding additional meanings a…
Morphological Analysis