ELMD: An Automatically Generated Entity Linking Gold Standard Dataset in the Music Domain
In this paper we present a gold standard dataset for Entity Linking (EL) in the Music Domain. It contains thousands of musical named entities such as Artist, Song or Record Label, which have been automatically annotated on a set of artist biographies coming from the Music website and social network Last.fm. The annotation process relies on the analysis of the hyperlinks present in the source texts and in a voting-based algorithm for EL, which considers, for each entity mention in text, the degree of agreement across three state-of-the-art EL systems. Manual evaluation shows that EL Precision is at least 94{\%}, and due to its tunable nature, it is possible to derive annotations favouring higher Precision or Recall, at will. We make available the annotated dataset along with evaluation data and the code.
Code (0)
등록된 구현이 없습니다.
Tasks
Entity LinkingSimilar Papers 제목 키워드 기반
Tweeki: Linking Named Entities on Twitter to a Knowledge Graph
To identify what entities are being talked about in tweets, we need to automatically link named entities that appear in tweets to structured KBs like WikiData. Existing approaches often struggle with such short, noisy te…
Entity LinkingBENGAL: An Automatic Benchmark Generator for Entity Recognition and Linking
The manual creation of gold standards for named entity recognition and entity linking is time- and resource-intensive. Moreover, recent works show that such gold standards contain a large proportion of mistakes in additi…
Entity Linkingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Improving Named Entity Linking Corpora Quality
Gold standard corpora and competitive evaluations play a key role in benchmarking named entity linking (NEL) performance and driving the development of more sophisticated NEL systems. The quality of the used corpora and …
BenchmarkingEntity LinkingKnowledge-Rich Self-Supervision for Biomedical Entity Linking
Entity linking faces significant challenges such as prolific variations and prevalent ambiguities, especially in high-value domains with myriad entities. Standard classification approaches suffer from the annotation bott…
Contrastive LearningEntity LinkingIn Media Res: A Corpus for Evaluating Named Entity Linking with Creative Works
Annotation styles express guidelines that direct human annotators in what rules to follow when creating gold standard annotations of text corpora. These guidelines not only shape the gold standards they help create, but …
Entity Linking