DegreEmbed: incorporating entity embedding into logic rule learning for knowledge graph reasoning
Knowledge graphs (KGs), as structured representations of real world facts, are intelligent databases incorporating human knowledge that can help machine imitate the way of human problem solving. However, KGs are usually huge and there are inevitably missing facts in KGs, thus undermining applications such as question answering and recommender systems that are based on knowledge graph reasoning. Link prediction for knowledge graphs is the task aiming to complete missing facts by reasoning based on the existing knowledge. Two main streams of research are widely studied: one learns low-dimensional embeddings for entities and relations that can explore latent patterns, and the other gains good interpretability by mining logical rules. Unfortunately, the heterogeneity of modern KGs that involve entities and relations of various types is not well considered in the previous studies. In this paper, we propose DegreEmbed, a model that combines embedding-based learning and logic rule mining for inferring on KGs. Specifically, we study the problem of predicting missing links in heterogeneous KGs from the perspective of the degree of nodes. Experimentally, we demonstrate that our DegreEmbed model outperforms the state-of-the-art methods on real world datasets and the rules mined by our model are of high quality and interpretability.
Code (1)
Tasks
Knowledge GraphsLink PredictionQuestion AnsweringRecommendation SystemsSimilar Papers 제목 키워드 기반
Lifted Rule Injection for Relation Embeddings
Methods based on representation learning currently hold the state-of-the-art in many natural language processing and knowledge base inference tasks. Yet, a major challenge is how to efficiently incorporate commonsense kn…
Knowledge Base ConstructionRelationRepresentation LearningKnowledge Graph Embedding with Entity Neighbors and Deep Memory Network
Knowledge Graph Embedding (KGE) aims to represent entities and relations of knowledge graph in a low-dimensional continuous vector space. Recent works focus on incorporating structural knowledge with additional informati…
Graph EmbeddingKnowledge Graph EmbeddingDoes Entity Abstraction Help Generative Transformers Reason?
We study the utility of incorporating entity type abstractions into pre-trained Transformers and test these methods on four NLP tasks requiring different forms of logical reasoning: (1) compositional language understandi…
Conversational Question AnsweringLogical ReasoningMulti-hop Question AnsweringQuestion Answering+1Table2Vec: Neural Word and Entity Embeddings for Table Population and Retrieval
Tables contain valuable knowledge in a structured form. We employ neural language modeling approaches to embed tabular data into vector spaces. Specifically, we consider different table elements, such caption, column hea…
Entity EmbeddingsLanguage ModelingLanguage ModellingRetrieval+3Benchmarking BioRelEx for Entity Tagging and Relation Extraction
Extracting relationships and interactions between different biological entities is still an extremely challenging problem but has not received much attention as much as extraction in other generic domains. In addition to…
BenchmarkingRelationRelation Extraction