Development of a rule-based lemmatization algorithm through Finite State Machine for Uzbek language
Lemmatization is one of the core concepts in natural language processing, thus creating a lemmatization tool is an important task. This paper discusses the construction of a lemmatization algorithm for the Uzbek language. The main purpose of the work is to remove affixes of words in the Uzbek language by means of the finite state machine and to identify a lemma (a word that can be found in the dictionary) of the word. The process of removing affixes uses a database of affixes and part of speech knowledge. This lemmatization consists of the general rules and a part of speech data of the Uzbek language, affixes, classification of affixes, removing affixes on the basis of the finite state machine for each class, as well as a definition of this word lemma.
Code (0)
등록된 구현이 없습니다.
Tasks
LEMMALemmatizationSimilar Papers 제목 키워드 기반
Lexicon and Rule-based Word Lemmatization Approach for the Somali Language
Lemmatization is a Natural Language Processing (NLP) technique used to normalize text by changing morphological derivations of words to their root forms. It is used as a core pre-processing step in many NLP tasks includi…
ArticlesInformation RetrievalLemmatizationRetrievalGliLem: Leveraging GliNER for Contextualized Lemmatization in Estonian
We present GliLem -- a novel hybrid lemmatization system for Estonian that enhances the highly accurate rule-based morphological analyzer Vabamorf with an external disambiguation module based on GliNER -- an open vocabul…
Information RetrievalLEMMALemmatizationNER+3Rule-based Automatic Multi-word Term Extraction and Lemmatization
In this paper we present a rule-based method for multi-word term extraction that relies on extensive lexical resources in the form of electronic dictionaries and finite-state transducers for modelling various syntactic s…
LEMMALemmatizationRetrievalTerm ExtractionBanLemma: A Word Formation Dependent Rule and Dictionary Based Bangla Lemmatizer
Lemmatization holds significance in both natural language processing (NLP) and linguistics, as it effectively decreases data density and aids in comprehending contextual meaning. However, due to the highly inflected natu…
LemmatizationSentenceDevelopment of a Hindi Lemmatizer
We live in a translingual society, in order to communicate with people from different parts of the world we need to have an expertise in their respective languages. Learning all these languages is not at all possible; th…
LemmatizationMachine TranslationMorphological AnalysisTranslation