The Knowledge Graph Track at OAEI -- Gold Standards, Baselines, and the Golden Hammer Bias
The Ontology Alignment Evaluation Initiative (OAEI) is an annual evaluation of ontology matching tools. In 2018, we have started the Knowledge Graph track, whose goal is to evaluate the simultaneous matching of entities and schemas of large-scale knowledge graphs. In this paper, we discuss the design of the track and two different strategies of gold standard creation. We analyze results and experiences obtained in first editions of the track, and, by revealing a hidden task, we show that all tools submitted to the track (and probably also to other tracks) suffer from a bias which we name the golden hammer bias.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge GraphsOntology MatchingSimilar Papers 제목 키워드 기반
OAEI Machine Learning Dataset for Online Model Generation
Ontology and knowledge graph matching systems are evaluated annually by the Ontology Alignment Evaluation Initiative (OAEI). More and more systems use machine learning-based approaches, including large language models. T…
Graph MatchingmodelSANOM Results for OAEI 2019
Simulated annealing-based ontology matching (SANOM) participates for the second time at the ontology alignment evaluation initiative (OAEI) 2019. This paper contains the configuration of SANOM and its results on the anat…
AnatomyOntology MatchingDKP-AOM: results for OAEI 2015
In this paper, we present the results obtained by our DKP-AOM system within the OAEI 2015 campaign. DKP-AOM is an ontology merging tool designed to merge heterogeneous ontologies. In OAEI, we have participated with its o…
AnatomyThe DLCC Node Classification Benchmark for Analyzing Knowledge Graph Embeddings
Knowledge graph embedding is a representation learning technique that projects entities and relations in a knowledge graph to continuous vector spaces. Embeddings have gained a lot of uptake and have been heavily used in…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge Graph EmbeddingsLink Prediction+3Gollum: A Gold Standard for Large Scale Multi Source Knowledge Graph Matching
The number of Knowledge Graphs (KGs) generated with automatic and manual approaches is constantly growing. For an integrated view and usage, an alignment between these KGs is necessary on the schema as well as instance l…
Graph MatchingKnowledge Graphs