Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs
The recent proliferation of knowledge graphs (KGs) coupled with incomplete or partial information, in the form of missing relations (links) between entities, has fueled a lot of research on knowledge base completion (also known as relation prediction). Several recent works suggest that convolutional neural network (CNN) based models generate richer and more expressive feature embeddings and hence also perform well on relation prediction. However, we observe that these KG embeddings treat triples independently and thus fail to cover the complex and hidden information that is inherently implicit in the local neighborhood surrounding a triple. To this effect, our paper proposes a novel attention based feature embedding that captures both entity and relation features in any given entity's neighborhood. Additionally, we also encapsulate relation clusters and multihop relations in our model. Our empirical study offers insights into the efficacy of our attention based model and we show marked performance gains in comparison to state of the art methods on all datasets.
Code (2)
Tasks
Knowledge Base CompletionKnowledge Graph CompletionKnowledge Graph EmbeddingsKnowledge GraphsLink PredictionRelationRelation PredictionSimilar Papers 제목 키워드 기반
Benchmarking neural embeddings for link prediction in knowledge graphs under semantic and structural changes
Recently, link prediction algorithms based on neural embeddings have gained tremendous popularity in the Semantic Web community, and are extensively used for knowledge graph completion. While algorithmic advances have st…
BenchmarkingKnowledge Graph CompletionKnowledge GraphsLink PredictionGlobal and local evaluation of link prediction tasks with neural embeddings
We focus our attention on the link prediction problem for knowledge graphs, which is treated herein as a binary classification task on neural embeddings of the entities. By comparing, combining and extending different me…
Binary ClassificationKnowledge GraphsLink PredictionPredictionLearning Attention-based Representations from Multiple Patterns for Relation Prediction in Knowledge Graphs
Knowledge bases, and their representations in the form of knowledge graphs (KGs), are naturally incomplete. Since scientific and industrial applications have extensively adopted them, there is a high demand for solutions…
Knowledge GraphsRelationRelation PredictionSelf-attention Presents Low-dimensional Knowledge Graph Embeddings for Link Prediction
A few models have tried to tackle the link prediction problem, also known as knowledge graph completion, by embedding knowledge graphs in comparably lower dimensions. However, the state-of-the-art results are attained at…
Knowledge Graph CompletionKnowledge Graph EmbeddingKnowledge Graph EmbeddingsKnowledge Graphs+1Holographic Embeddings of Knowledge Graphs
Learning embeddings of entities and relations is an efficient and versatile method to perform machine learning on relational data such as knowledge graphs. In this work, we propose holographic embeddings (HolE) to learn …
Knowledge GraphsLink PredictionRelational Reasoning