Distributed Representations of Entities in Open-World Knowledge Graphs
Graph neural network (GNN)-based methods have demonstrated remarkable performance in various knowledge graph (KG) tasks. However, most existing approaches rely on observing all entities during training, posing a challenge in real-world knowledge graphs where new entities emerge frequently. To address this limitation, we introduce Decentralized Attention Network (DAN). DAN leverages neighbor context as the query vector to score the neighbors of an entity, thereby distributing the entity semantics only among its neighbor embeddings. To effectively train a DAN, we introduce self-distillation, a technique that guides the network in generating desired representations. Theoretical analysis validates the effectiveness of our approach. We implement an end-to-end framework and conduct extensive experiments to evaluate our method, showcasing competitive performance on conventional entity alignment and entity prediction tasks. Furthermore, our method significantly outperforms existing methods in open-world settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Entity AlignmentGraph Neural NetworkGraph Representation LearningKnowledge GraphsRepresentation LearningWorld KnowledgeSimilar Papers 제목 키워드 기반
GeoVectors: A Linked Open Corpus of OpenStreetMap Embeddings on World Scale
OpenStreetMap (OSM) is currently the richest publicly available information source on geographic entities (e.g., buildings and roads) worldwide. However, using OSM entities in machine learning models and other applicatio…
BIG-bench Machine LearningEntity EmbeddingsKnowledge GraphsLearning Distributed Representations of Texts and Entities from Knowledge Base
We describe a neural network model that jointly learns distributed representations of texts and knowledge base (KB) entities. Given a text in the KB, we train our proposed model to predict entities that are relevant to t…
Entity DisambiguationEntity LinkingQuestion AnsweringSentenceRelation Specific Transformations for Open World Knowledge Graph Completion
We propose an open-world knowledge graph completion model that can be combined with common closed-world approaches (such as ComplEx) and enhance them to exploit text-based representations for entities unseen in training.…
Knowledge Graph CompletionLink PredictionRelationWorld KnowledgeWorldKG: A World-Scale Geographic Knowledge Graph
OpenStreetMap is a rich source of openly available geographic information. However, the representation of geographic entities, e.g., buildings, mountains, and cities, within OpenStreetMap is highly heterogeneous, diverse…
RAILD: Towards Leveraging Relation Features for Inductive Link Prediction In Knowledge Graphs
Due to the open world assumption, Knowledge Graphs (KGs) are never complete. In order to address this issue, various Link Prediction (LP) methods are proposed so far. Some of these methods are inductive LP models which a…
Inductive Link PredictionKnowledge GraphsLink PredictionRelation