Improved Knowledge Graph Embedding using Background Taxonomic Information
Knowledge graphs are used to represent relational information in terms of triples. To enable learning about domains, embedding models, such as tensor factorization models, can be used to make predictions of new triples. Often there is background taxonomic information (in terms of subclasses and subproperties) that should also be taken into account. We show that existing fully expressive (a.k.a. universal) models cannot provably respect subclass and subproperty information. We show that minimal modifications to an existing knowledge graph completion method enables injection of taxonomic information. Moreover, we prove that our model is fully expressive, assuming a lower-bound on the size of the embeddings. Experimental results on public knowledge graphs show that despite its simplicity our approach is surprisingly effective.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph EmbeddingKnowledge Graph CompletionKnowledge Graph EmbeddingKnowledge GraphsSimilar Papers 제목 키워드 기반
Semantic Relatedness and Taxonomic Word Embeddings
This paper connects a series of papers dealing with taxonomic word embeddings. It begins by noting that there are different types of semantic relatedness and that different lexical representations encode different forms …
Word EmbeddingsUncovering the Semantics of Wikipedia Categories
The Wikipedia category graph serves as the taxonomic backbone for large-scale knowledge graphs like YAGO or Probase, and has been used extensively for tasks like entity disambiguation or semantic similarity estimation. W…
Entity DisambiguationKnowledge GraphsSemantic SimilaritySemantic Textual SimilarityCross-Modal Contextualized Hidden State Projection Method for Expanding of Taxonomic Graphs
Taxonomy is a graph of terms organized hierarchically using is-a (hypernymy) relations. We suggest novel candidate-free task formulation for the taxonomy enrichment task. To solve the task, we leverage lexical knowledge …
graph constructionGraph EmbeddingSynthetic, yet natural: Properties of WordNet random walk corpora and the impact of rare words on embedding performance
Creating word embeddings that reflect semantic relationships encoded in lexical knowledge resources is an open challenge. One approach is to use a random walk over a knowledge graph to generate a pseudo-corpus and use th…
Word EmbeddingsWord SimilarityProbing Taxonomic and Thematic Embeddings for Taxonomic Information
Modelling taxonomic and thematic relatedness is important for building AI with comprehensive natural language understanding. The goal of this paper is to learn more about how taxonomic information is structurally encoded…
Natural Language Understanding