Improving Named Entity Linking Corpora Quality

2019-09-01 · RANLP 2019 9 · Albert Weichselbraun, Adrian M.P. Brasoveanu, Philipp Kuntschik, Lyndon J.B. Nixon

Gold standard corpora and competitive evaluations play a key role in benchmarking named entity linking (NEL) performance and driving the development of more sophisticated NEL systems. The quality of the used corpora and the used evaluation metrics are crucial in this process. We, therefore, assess the quality of three popular evaluation corpora, identifying four major issues which affect these gold standards: (i) the use of different annotation styles, (ii) incorrect and missing annotations, (iii) Knowledge Base evolution, (iv) and differences in annotating co-occurrences. This paper addresses these issues by formalizing NEL annotations and corpus versioning which allows standardizing corpus creation, supports corpus evolution, and paves the way for the use of lenses to automatically transform between different corpus configurations. In addition, the use of clearly defined scoring rules and evaluation metrics ensures a better comparability of evaluation results.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Benchmarking Entity Linking

Visual Named Entity Linking: A New Dataset and A Baseline

2022-11-09 · Wenxiang Sun, Yixing Fan, Jiafeng Guo, Ruqing Zhang 외

Visual Entity Linking (VEL) is a task to link regions of images with their corresponding entities in Knowledge Bases (KBs), which is beneficial for many computer vision tasks such as image retrieval, image caption, and v…

Entity Linking Image Retrieval Question Answering Retrieval+2

DAMO-NLP at NLPCC-2022 Task 2: Knowledge Enhanced Robust NER for Speech Entity Linking

2022-09-27 · Shen Huang, Yuchen Zhai, Xinwei Long, Yong Jiang 외

Speech Entity Linking aims to recognize and disambiguate named entities in spoken languages. Conventional methods suffer gravely from the unfettered speech styles and the noisy transcripts generated by ASR systems. In th…

Entity Linking named-entity-recognition Named Entity Recognition Named Entity Recognition (NER)+4

Linguistic Resources for Entity Linking Evaluation: from Monolingual to Cross-lingual

2012-05-01 · LREC 2012 5 · Xuansong Li, Stephanie Strassel, Heng Ji, Kira Griffitt 외

To advance information extraction and question answering technologies toward a more realistic path, the U.S. NIST (National Institute of Standards and Technology) initiated the KBP (Knowledge Base Population) task as one…

Cross-Lingual Entity Linking Entity Linking Knowledge Base Population Named Entity Recognition (NER)+3

An Unsupervised Language-Independent Entity Disambiguation Method and its Evaluation on the English and Persian Languages

2021-01-31 · Majid Asgari-Bidhendi, Behrooz Janfada, Amir Havangi, Sayyed Ali Hossayni 외

Entity Linking is one of the essential tasks of information extraction and natural language understanding. Entity linking mainly consists of two tasks: recognition and disambiguation of named entities. Most studies addre…

Entity Disambiguation Entity Linking Natural Language Understanding

A Regional News Corpora for Contextualized Entity Discovery and Linking

2016-05-01 · LREC 2016 5 · Adrian Bra{\c{s}}oveanu, Lyndon J.B. Nixon, Albert Weichselbraun, Arno Scharl

This paper presents a German corpus for Named Entity Linking (NEL) and Knowledge Base Population (KBP) tasks. We describe the annotation guideline, the annotation process, NIL clustering techniques and conversion to popu…

Clustering Entity Linking Knowledge Base Population