CLIMATELI: Evaluating Entity Linking on Climate Change Data
Climate Change (CC) is a pressing topic of global importance, attracting increasing attention across research fields, from social sciences to Natural Language Processing (NLP). CC is also discussed in various settings and communication platforms, from academic publications to social media forums. Understanding who and what is mentioned in such data is a first critical step to gaining new insights into CC. We present CLIMATELI (CLIMATe Entity LInking), the first manually annotated CC dataset that links 3,087 entity spans to Wikipedia. Using CLIMATELI (CLIMATe Entity LInking), we evaluate existing entity linking (EL) systems on the CC topic across various genres and propose automated filtering methods for CC entities. We find that the performance of EL models notably lags behind humans at both token and entity levels. Testing within the scope of retaining or excluding non-nominal and/or non-CC entities particularly impacts the models' performances.
Code (0)
등록된 구현이 없습니다.
Tasks
Entity LinkingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Taec: a Manually annotated text dataset for trait and phenotype extraction and entity linking in wheat breeding literature
Wheat varieties show a large diversity of traits and phenotypes. Linking them to genetic variability is essential for shorter and more efficient wheat breeding programs. Newly desirable wheat variety traits include disea…
ArticlesEntity Linkingnamed-entity-recognitionNamed Entity RecognitionEvaluating Entity Linking: An Analysis of Current Benchmark Datasets and a Roadmap for Doing a Better Job
Entity linking has become a popular task in both natural language processing and semantic web communities. However, we find that the benchmark datasets for entity linking tasks do not accurately evaluate entity linking s…
Entity LinkingCADEL: A Corpus of Administrative Web Documents for Japanese Entity Linking
Entity linking is the task of associating linguistic expressions with entries in a knowledge base that represent real-world entities and concepts. Language resources for this task have primarily been developed for Englis…
Entity DisambiguationEntity LinkingReviewing climate change and agricultural market competitiveness
The paper is a collection of knowledge regarding the phenomenon of climate change, competitiveness, and literature linking the two phenomena to agricultural market competitiveness. The objective is to investigate the pee…
Where on Earth Do Users Say They Are?: Geo-Entity Linking for Noisy Multilingual User Input
Geo-entity linking is the task of linking a location mention to the real-world geographic location. In this paper we explore the challenging task of geo-entity linking for noisy, multilingual social media data. There are…
Entity Linking