Cross-lingual tagger evaluation without test data
We address the challenge of cross-lingual POS tagger evaluation in absence of manually annotated test data. We put forth and evaluate two dictionary-based metrics. On the tasks of accuracy prediction and system ranking, we reveal that these metrics are reliable enough to approximate test set-based evaluation, and at the same time lean enough to support assessment for truly low-resource languages.
Code (0)
등록된 구현이 없습니다.
Tasks
POSSimilar Papers 제목 키워드 기반
Multilingual Projection for Parsing Truly Low-Resource Languages
We propose a novel approach to cross-lingual part-of-speech tagging and dependency parsing for truly low-resource languages. Our annotation projection-based approach yields tagging and parsing models for over 100 languag…
Cross-Lingual TransferDependency ParsingPart-Of-Speech TaggingTransfer LearningA Tagged Corpus and a Tagger for Urdu
In this paper, we describe a release of a sizeable monolingual Urdu corpus automatically tagged with part-of-speech tags. We extend the work of Jawaid and Bojar (2012) who use three different taggers and then apply a vot…
Multilingual Open Relation Extraction Using Cross-lingual Projection
Open domain relation extraction systems identify relation and argument phrases in a sentence without relying on any underlying schema. However, current state-of-the-art relation extraction systems are available only for …
RelationRelation ExtractionSentenceFrom Traditional Taggers to LLMs: A Comparative Study of POS Tagging for Medieval Romance Languages
Part-of-speech (POS) tagging for Medieval Romance languages remains challenging due to orthographic variation, morphological complexity, and limited annotated resources. This paper presents a systematic empirical evaluat…
Cross-Lingual TransferPOS TaggingInducing Multilingual Text Analysis Tools Using Bidirectional Recurrent Neural Networks
This work focuses on the rapid development of linguistic annotation tools for resource-poor languages. We experiment several cross-lingual annotation projection methods using Recurrent Neural Networks (RNN) models. The d…
POSTranslationWord Alignment