Wiki-TabNER: Integrating Named Entity Recognition into Wikipedia Tables
Interest in solving table interpretation tasks has grown over the years, yet it still relies on existing datasets that may be overly simplified. This is potentially reducing the effectiveness of the dataset for thorough evaluation and failing to accurately represent tables as they appear in the real-world. To enrich the existing benchmark datasets, we extract and annotate a new, more challenging dataset. The proposed Wiki-TabNER dataset features complex tables containing several entities per cell, with named entities labeled using DBpedia classes. This dataset is specifically designed to address named entity recognition (NER) task within tables, but it can also be used as a more challenging dataset for evaluating the entity linking task. In this paper we describe the distinguishing features of the Wiki-TabNER dataset and the labeling process. In addition, we propose a prompting framework for evaluating the new large language models on the within tables NER task. Finally, we perform qualitative analysis to gain insights into the challenges encountered by the models and to understand the limitations of the proposed~dataset.
Code (1)
Tasks
Entity Linkingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERSimilar Papers 제목 키워드 기반
pioNER: Datasets and Baselines for Armenian Named Entity Recognition
In this work, we tackle the problem of Armenian named entity recognition, providing silver- and gold-standard datasets as well as establishing baseline results on popular models. We present a 163000-token named entity co…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Word EmbeddingsFine-Grained Named Entity Recognition using ELMo and Wikidata
Fine-grained Named Entity Recognition is a task whereby we detect and classify entity mentions to a large set of types. These types can span diverse domains such as finance, healthcare, and politics. We observe that when…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Cross-Lingual Named Entity Recognition via Wikification
Named Entity Corpus Construction using Wikipedia and DBpedia Ontology
In this paper, we propose a novel method to automatically build a named entity corpus based on the DBpedia ontology. Since most of named entity recognition systems require time and effort consuming annotation tasks as tr…
Entity Disambiguationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1SU-NLP at SemEval-2022 Task 11: Complex Named Entity Recognition with Entity Linking
This paper describes the system proposed by Sabanc{\i} University Natural Language Processing Group in the SemEval-2022 MultiCoNER task. We developed an unsupervised entity linking pipeline that detects potential entity …
Entity Linkingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)