Using a Small Lexicon with CRFs Confidence Measure to Improve POS Tagging Accuracy
Like most of the languages which have only recently started being investigated for the Natural Language Processing (NLP) tasks, Amazigh lacks annotated corpora and tools and still suffers from the scarcity of linguistic tools and resources. The main aim of this paper is to present a new part-of-speech (POS) tagger based on a new Amazigh tag set (AMTS) composed of 28 tags. In line with our goal we have trained Conditional Random Fields (CRFs) to build a POS tagger for the Amazigh language. We have used the 10-fold technique to evaluate and validate our approach. The CRFs 10 folds average level is 87.95{\%} and the best fold level result is 91.18{\%}. In order to improve this result, we have gathered a set of about 8k words with their POS tags. The collected lexicon was used with CRFs confidence measure in order to have a more accurate POS-tagger. Hence, we have obtained a better performance of 93.82{\%}.
Code (0)
등록된 구현이 없습니다.
Tasks
8kPOSPOS TaggingTAGSimilar Papers 제목 키워드 기반
Confidence Prediction for Lexicon-Free OCR
Having a reliable accuracy score is crucial for real world applications of OCR, since such systems are judged by the number of false readings. Lexicon-based OCR systems, which deal with what is essentially a multi-class …
General ClassificationMulti-class ClassificationOptical Character Recognition (OCR)PredictionTLT-CRF: A Lexicon-supported Morphological Tagger for Latin Based on Conditional Random Fields
We present a morphological tagger for Latin, called TTLab Latin Tagger based on Conditional Random Fields (TLT-CRF) which uses a large Latin lexicon. Beyond Part of Speech (PoS), TLT-CRF tags eight inflectional categorie…
POSLST: Lexicon-Guided Self-Training for Few-Shot Text Classification
Self-training provides an effective means of using an extremely small amount of labeled data to create pseudo-labels for unlabeled data. Many state-of-the-art self-training approaches hinge on different regularization me…
ClassificationFew-Shot Text Classificationtext-classificationText ClassificationExternal Lexical Information for Multilingual Part-of-Speech Tagging
Morphosyntactic lexicons and word vector representations have both proven useful for improving the accuracy of statistical part-of-speech taggers. Here we compare the performances of four systems on datasets covering 16 …
Part-Of-Speech Tagging