Fine-Grained Evaluation for Entity Linking
The Entity Linking (EL) task identifies entity mentions in a text corpus and associates them with an unambiguous identifier in a Knowledge Base. While much work has been done on the topic, we first present the results of a survey that reveal a lack of consensus in the community regarding what forms of mentions in a text and what forms of links the EL task should consider. We argue that no one definition of the Entity Linking task fits all, and rather propose a fine-grained categorization of different types of entity mentions and links. We then re-annotate three EL benchmark datasets {--} ACE2004, KORE50, and VoxEL {--} with respect to these categories. We propose a fuzzy recall metric to address the lack of consensus and conclude with fine-grained evaluation results comparing a selection of online EL systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Entity LinkingSimilar Papers 제목 키워드 기반
LATTE: Latent Type Modeling for Biomedical Entity Linking
Entity linking is the task of linking mentions of named entities in natural language text, to entities in a curated knowledge-base. This is of significant importance in the biomedical domain, where it could be used to se…
Entity DisambiguationEntity LinkingVocal Bursts Type PredictionImproving Fine-grained Entity Typing with Entity Linking
Fine-grained entity typing is a challenging problem since it usually involves a relatively large tag set and may require to understand the context of the entity mention. In this paper, we use entity linking to help with …
Entity LinkingEntity TypingTAGReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linking
We introduce ReFinED, an efficient end-to-end entity linking model which uses fine-grained entity types and entity descriptions to perform linking. The model performs mention detection, fine-grained entity typing, and en…
Entity DisambiguationEntity LinkingEntity TypingImproving Entity Linking by Encoding Type Information into Entity Embeddings
“Entity Linking (EL) refers to the task of linking entity mentions in the text to the correct entities inthe Knowledge Base (KB) in which entity embeddings play a vital and challenging role because of the subtle differen…
Entity EmbeddingsEntity LinkingVocal Bursts Type PredictionELEVANT: A Fully Automatic Fine-Grained Entity Linking Evaluation and Analysis Tool
We present Elevant, a tool for the fully automatic fine-grained evaluation of a set of entity linkers on a set of benchmarks. Elevant provides an automatic breakdown of the performance by various error categories and by …
Entity Linking