Comprehensive Part-Of-Speech Tag Set and SVM based POS Tagger for Sinhala
This paper presents a new comprehensive multi-level Part-Of-Speech tag set and a Support Vector Machine based Part-Of-Speech tagger for the Sinhala language. The currently available tag set for Sinhala has two limitations: the unavailability of tags to represent some word classes and the lack of tags to capture inflection based grammatical variations of words. The new tag set, presented in this paper overcomes both of these limitations. The accuracy of available Sinhala Part-Of-Speech taggers, which are based on Hidden Markov Models, still falls far behind state of the art. Our Support Vector Machine based tagger achieved an overall accuracy of 84.68{\%} with 59.86{\%} accuracy for unknown words and 87.12{\%} for known words, when the test set contains 10{\%} of unknown words.
Code (0)
등록된 구현이 없습니다.
Tasks
POSTAGSimilar Papers 제목 키워드 기반
Hidden Markov Model Based Part of Speech Tagger for Sinhala Language
In this paper we present a fundamental lexical semantics of Sinhala language and a Hidden Markov Model (HMM) based Part of Speech (POS) Tagger for Sinhala language. In any Natural Language processing task, Part of Speech…
POSTAGBuilding a Linguistic Resource : A Word Frequency List for Sinhala
A word frequency list is a list of unique words in a language along with their frequency count. It is generally sorted by frequency. Such a list is essential for many NLP tasks, including building language models, POS ta…
POSWord Embedding Evaluation for Sinhala
This paper presents the first ever comprehensive evaluation of different types of word embeddings for Sinhala language. Three standard word embedding models, namely, Word2Vec (both Skipgram and CBOW), FastText, and Glove…
Part-Of-Speech TaggingPOSPOS TaggingSentiment Analysis+1A Systematic Approach to Derive a Refined Speech Corpus for Sinhala
Speech Recognition is an active research area where advances of technology have continuously driven the development of research work. However, due to the lack of adequate resources, certain languages such as Sinhala, are…
speech-recognitionSpeech RecognitionA Low-Resource Speech-Driven NLP Pipeline for Sinhala Dyslexia Assistance
Dyslexia in adults remains an under-researched and under-served area, particularly in non-English-speaking contexts, despite its significant impact on personal and professional lives. This work addresses that gap by focu…