Correcting Errors in a New Gold Standard for Tagging Icelandic Text
In this paper, we describe the correction of PoS tags in a new Icelandic corpus, MIM-GOLD, consisting of about 1 million tokens sampled from the Tagged Icelandic Corpus, M{\'I}M, released in 2013. The goal is to use the corpus, among other things, as a new gold standard for training and testing PoS taggers. The construction of the corpus was first described in 2010 together with preliminary work on error detection and correction. In this paper, we describe further the correction of tags in the corpus. We describe manual correction and a method for semi-automatic error detection and correction. We show that, even after manual correction, the number of tagging errors in the corpus can be reduced significantly by applying our semi-automatic detection and correction method. After the semi-automatic error correction, preliminary evaluation of tagging accuracy shows very low error rates. We hope that the existence of the corpus will make it possible to improve PoS taggers for Icelandic text.
Code (0)
등록된 구현이 없습니다.
Tasks
Part-Of-Speech TaggingPOSSimilar Papers 제목 키워드 기반
Analysing Inconsistencies and Errors in PoS Tagging in two Icelandic Gold Standards
Augmenting a BiLSTM tagger with a Morphological Lexicon and a Lexical Category Identification Step
Previous work on using BiLSTM models for PoS tagging has primarily focused on small tagsets. We evaluate BiLSTM models for tagging Icelandic, a morphologically rich language, using a relatively large tagset. Our baseline…
POSPOS TaggingTAGTowards cross-lingual application of language-specific PoS tagging schemes
We describe the process of conversion between the PoS tagging schemes of two languages, the Icelandic MIM-GOLD tagging scheme and the Faroese Sosialurin tagging scheme. These tagging schemes are functionally similar but …
POSPOS TaggingTransfer LearningTowards High Accuracy Named Entity Recognition for Icelandic
We report on work in progress which consists of annotating an Icelandic corpus for named entities (NEs) and using it for training a named entity recognizer based on a Bidirectional Long Short-Term Memory model. Currently…
Miscellaneousnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+3Developing a Faroese PoS-tagging solution using Icelandic methods
We describe the development of a dedicated, high-accuracy part-of-speech (PoS) tagging solution for Faroese, a North Germanic language with about 50,000 speakers. To achieve this, a state-of-the-art neural PoS tagger for…
Part-Of-Speech TaggingPOSPOS Tagging