Contextual Semantic Embeddings for Ontology Subsumption Prediction
Automating ontology construction and curation is an important but challenging task in knowledge engineering and artificial intelligence. Prediction by machine learning techniques such as contextual semantic embedding is a promising direction, but the relevant research is still preliminary especially for expressive ontologies in Web Ontology Language (OWL). In this paper, we present a new subsumption prediction method named BERTSubs for classes of OWL ontology. It exploits the pre-trained language model BERT to compute contextual embeddings of a class, where customized templates are proposed to incorporate the class context (e.g., neighbouring classes) and the logical existential restriction. BERTSubs is able to predict multiple kinds of subsumers including named classes from the same ontology or another ontology, and existential restrictions from the same ontology. Extensive evaluation on five real-world ontologies for three different subsumption tasks has shown the effectiveness of the templates and that BERTSubs can dramatically outperform the baselines that use (literal-aware) knowledge graph embeddings, non-contextual word embeddings and the state-of-the-art OWL ontology embeddings.
Code (2)
Tasks
Knowledge Graph EmbeddingsLanguage ModelingLanguage ModellingPredictionWord EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Self-matching Training Method with Annotation Embedding Models for Ontology Subsumption Prediction
Recently, ontology embeddings representing entities in a low-dimensional space have been proposed for ontology completion. However, the ontology embeddings for concept subsumption prediction do not address the difficulti…
Ontology EmbeddingNeurOWL: An LLM-Based Neural-symbolic Framework for Incomplete OWL Ontology Reasoning
OWL ontologies provide a formal knowledge representation framework that enables semantic reasoning, and have been widely adopted across domains such as healthcare and bioinformatics. In practice, however, real-world onto…
Dual Box Embeddings for the Description Logic EL++
OWL ontologies, whose formal semantics are rooted in Description Logic (DL), have been widely used for knowledge representation. Similar to Knowledge Graphs (KGs), ontologies are often incomplete, and maintaining and con…
Knowledge GraphsLink PredictionOntology EmbeddingRepresentation LearningOntology-based n-ball Concept Embeddings Informing Few-shot Image Classification
We propose a novel framework named ViOCE that integrates ontology-based background knowledge in the form of $n$-ball concept embeddings into a neural network based vision architecture. The approach consists of two compon…
Few-Shot Image Classificationimage-classificationImage ClassificationOWL2Vec*: Embedding of OWL Ontologies
Semantic embedding of knowledge graphs has been widely studied and used for prediction and statistical analysis tasks across various domains such as Natural Language Processing and the Semantic Web. However, less attenti…
Knowledge GraphsLanguage ModellingOntology EmbeddingPrediction