Part of Speech Tagging for a Resource Poor Language : Sindhi in Devanagari Script using HMM and CRF
Part of speech tagging is a pre-processing step of various NLP applications. Mainly it is used in Machine Translation. This research proposes two POS taggers, i.e., an HMM-based and CRF based tagger. To develop this tagger, the corpus of manually annotated 30,000 sentences has been prepared with the help of language experts. In this paper, we have developed POS taggers for Sindhi Language (in Devanagari Script), a resource poor language, using HMM (Hidden Markov Model) and Conditional Random Field (CRF).Evaluation results demonstrated the accuracies of 76.60714% and 88.79% in the HMM, and CRF, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationPart-Of-Speech TaggingPOSTranslationSimilar Papers 제목 키워드 기반
Zero Resource Cross-Lingual Part Of Speech Tagging
Part of speech tagging in zero-resource settings can be an effective approach for low-resource languages when no labeled training data is available. Existing systems use two main techniques for POS tagging i.e. pretraine…
Part-Of-Speech TaggingPOSPOS TaggingTransfer LearningAutomatic Part-of-Speech Tagging of Arabic-English Dictionary Senses through WordNet
This paper proposed an algorithm for part-of-speech (POS) tagging senses of a bilingual dictionary. The algorithm is applied on the Al-Mawrid Arabic-English dictionary. The tagging task is accomplished by transferring th…
Part-Of-Speech TaggingPOS TaggingToken and Type Constraints for Cross-Lingual Part-of-Speech Tagging
We consider the construction of part-of-speech taggers for resource-poor languages. Recently, manually constructed tag dictionaries from Wiktionary and dictionaries projected via bitext have been used as type constraints…
Machine TranslationNamed Entity Recognition (NER)Part-Of-Speech TaggingSemantic Parsing+2Data Augmentation via Dependency Tree Morphing for Low-Resource Languages
Neural NLP systems achieve high scores in the presence of sizable training dataset. Lack of such datasets leads to poor system performances in the case low-resource languages. We present two simple text augmentation tech…
Data AugmentationPart-Of-Speech TaggingText AugmentationPart-of-speech tagging for Nagamese Language using CRF
This paper investigates part-of-speech tagging, an important task in Natural Language Processing (NLP) for the Nagamese language. The Nagamese language, a.k.a. Naga Pidgin, is an Assamese-lexified Creole language develop…
Part-Of-Speech Tagging