A method for in-depth comparative evaluation: How (dis)similar are outputs of pos taggers, dependency parsers and coreference resolvers really?

2017-04-01 · EACL 2017 4 · Don Tuggener

This paper proposes a generic method for the comparative evaluation of system outputs. The approach is able to quantify the pairwise differences between two outputs and to unravel in detail what the differences consist of. We apply our approach to three tasks in Computational Linguistics, i.e. POS tagging, dependency parsing, and coreference resolution. We find that system outputs are more distinct than the (often) small differences in evaluation scores seem to suggest.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

coreference-resolution Coreference Resolution Dependency ParsingPOSPOS Tagging

Evaluation of Three Welsh Language POS Taggers

2022-06-01 · CLTW (LREC) 2022 6 · Gruffudd Prys, Gareth Watkins

In this paper we describe our quantitative and qualitative evaluation of three Welsh language Part of Speech (POS) taggers. Following an introductory section, we explore some of the issues which face POS taggers, discuss…

Benchmarking POS

Character Eyes: Seeing Language through Character-Level Taggers

2019-03-12 · WS 2019 8 · Yuval Pinter, Marc Marone, Jacob Eisenstein

Character-level models have been used extensively in recent years in NLP tasks as both supplements and replacements for closed-vocabulary token-level word representations. In one popular architecture, character-level LST…

POS

From Traditional Taggers to LLMs: A Comparative Study of POS Tagging for Medieval Romance Languages

2026-05-09 · Matthias Schöffel, Esteban Garces Arias arxiv

Part-of-speech (POS) tagging for Medieval Romance languages remains challenging due to orthographic variation, morphological complexity, and limited annotated resources. This paper presents a systematic empirical evaluat…

Cross-Lingual Transfer POS Tagging

Predicting Phrase Breaks in Classical and Modern Standard Arabic Text

2012-05-01 · LREC 2012 5 · Majdi Sawalha, Claire Brierley, Eric Atwell

We train and test two probabilistic taggers for Arabic phrase break prediction on a purpose-built, gold standard, boundary-annotated and PoS-tagged Qur'an corpus of 77430 words and 8230 sentences. In a related LREC pap…

Chunking Human Parsing Part-Of-Speech Tagging POS+1

AraSAS: The Open Source Arabic Semantic Tagger

2022-06-01 · OSACT (LREC) 2022 6 · Mahmoud El-Haj, Elvis de Souza, Nouran Khallaf, Paul Rayson 외

This paper presents (AraSAS) the first open-source Arabic semantic analysis tagging system. AraSAS is a software framework that provides full semantic tagging of text written in Arabic. AraSAS is based on the UCREL Seman…

Diversity TAG