Tagger for Polish Computer Mediated Communication Texts
In this paper we present a morpho-syntactic tagger dedicated to Computer-mediated Communication texts in Polish. Its construction is based on an expanded RNN-based neural network adapted to the work on noisy texts. Among several techniques, the tagger utilises fastText embedding vectors, sequential character embedding vectors, and Brown clustering for the coarse-grained representation of sentence structures. In addition a set of manually written rules was proposed for post-processing. The system was trained to disambiguate descriptions of words in relation to Parts of Speech tags together with the full morphological information in terms of values for the different grammatical categories. We present also evaluation of several model variants on the gold standard annotated CMC data, comparison to the state-of-the-art taggers for Polish and error analysis. The proposed tagger shows significantly better results in this domain and demonstrates the viability of adaptation.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ProtagonistTagger -- a Tool for Entity Linkage of Persons in Texts from Various Languages and Domains
Named entities recognition (NER) and disambiguation (NED) can add semantic context to the recognized named entities in texts. Named entity linkage in texts, regardless of a domain, provides links between the entities men…
NERPoliTa: A multitagger for Polish
Part-of-Speech (POS) tagging is a crucial task in Natural Language Processing (NLP). POS tags may be assigned to tokens in text manually, by trained linguists, or using algorithmic approaches. Particularly, in the case o…
Part-Of-Speech TaggingPOSPOS TaggingSentiment Analysis+1Polish -English Statistical Machine Translation of Medical Texts
This new research explores the effects of various training methods on a Polish to English Statistical Machine Translation system for medical texts. Various elements of the EMEA parallel text corpora from the OPUS project…
Machine TranslationPOSPOS TaggingTranslationDetecting spelling variants in non-standard texts
Spelling variation in non-standard language, e.g. computer-mediated communication and historical texts, is usually treated as a deviation from a standard spelling, e.g. 2mr as an non-standard spelling for tomorrow. Conse…
ADMEDTAGGER: an annotation framework for distillation of expert knowledge for the Polish medical language
In this work, we present an annotation framework that demonstrates how a multilingual LLM pretrained on a large corpus can be used as a teacher model to distill the expert knowledge needed for tagging medical texts in Po…