Comparison of Current Approaches to Lemmatization: A Case Study in Estonian
This study evaluates three different lemmatization approaches to Estonian -- Generative character-level models, Pattern-based word-level classification models, and rule-based morphological analysis. According to our experiments, a significantly smaller Generative model consistently outperforms the Pattern-based classification model based on EstBERT. Additionally, we observe a relatively small overlap in errors made by all three models, indicating that an ensemble of different approaches could lead to improvements.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationLemmatizationMorphological AnalysisSimilar Papers 제목 키워드 기반
Context Aware Lemmatization and Morphological Tagging Method in Turkish
The smallest part of a word that defines the word is called a word root. Word roots are used to increase success in many applications since they simplify the word. In this study, the lemmatization model, which is a word …
LemmatizationMorphological TaggingLexicon-assisted tagging and lemmatization in Latin: A comparison of six taggers and two lemmatization methods
Lemmatization of Multi-word Common Noun Phrases and Named Entities in Polish
In the paper we present a tool for lemmatization of multi-word common noun phrases and named entities for Polish called LemmaPL. The tool is based on a set of manually crafted rules and heuristics utilizing a set of dict…
LemmatizationEvaluating Contextualized Embeddings on 54 Languages in POS Tagging, Lemmatization and Dependency Parsing
We present an extensive evaluation of three recently proposed methods for contextualized embeddings on 89 corpora in 54 languages of the Universal Dependencies 2.3 in three tasks: POS tagging, lemmatization, and dependen…
Dependency ParsingLemmatizationPOSPOS Tagging+1BanLemma: A Word Formation Dependent Rule and Dictionary Based Bangla Lemmatizer
Lemmatization holds significance in both natural language processing (NLP) and linguistics, as it effectively decreases data density and aids in comprehending contextual meaning. However, due to the highly inflected natu…
LemmatizationSentence