Extending Transductive Knowledge Graph Embedding Models for Inductive Logical Relational Inference
Many downstream inference tasks for knowledge graphs, such as relation prediction, have been handled successfully by knowledge graph embedding techniques in the transductive setting. To address the inductive setting wherein new entities are introduced into the knowledge graph at inference time, more recent work opts for models which learn implicit representations of the knowledge graph through a complex function of a network's subgraph structure, often parametrized by graph neural network architectures. These come at the cost of increased parametrization, reduced interpretability and limited generalization to other downstream inference tasks. In this work, we bridge the gap between traditional transductive knowledge graph embedding approaches and more recent inductive relation prediction models by introducing a generalized form of harmonic extension which leverages representations learned through transductive embedding methods to infer representations of new entities introduced at inference time as in the inductive setting. This harmonic extension technique provides the best such approximation, can be implemented via an efficient iterative scheme, and can be employed to answer a family of conjunctive logical queries over the knowledge graph, further expanding the capabilities of transductive embedding methods. In experiments on a number of large-scale knowledge graph embedding benchmarks, we find that this approach for extending the functionality of transductive knowledge graph embedding models to perform knowledge graph completion and answer logical queries in the inductive setting is competitive with--and in some scenarios outperforms--several state-of-the-art models derived explicitly for such inductive tasks.
Code (1)
Tasks
Graph EmbeddingGraph Neural NetworkInductive Relation PredictionKnowledge Graph CompletionKnowledge Graph EmbeddingKnowledge GraphsRelation PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Inductive Relation Prediction by Subgraph Reasoning
The dominant paradigm for relation prediction in knowledge graphs involves learning and operating on latent representations (i.e., embeddings) of entities and relations. However, these embedding-based methods do not expl…
Graph EmbeddingGraph Neural NetworkInductive BiasInductive knowledge graph completion+9Inductive Relation Prediction by BERT
Relation prediction in knowledge graphs is dominated by embedding based methods which mainly focus on the transductive setting. Unfortunately, they are not able to handle inductive learning where unseen entities and rela…
Few-Shot LearningInductive LearningInductive Relation PredictionKnowledge Graphs+6iN2V: Bringing Transductive Node Embeddings to Inductive Graphs
Shallow node embeddings like node2vec (N2V) can be used for nodes without features or to supplement existing features with structure-based information. Embedding methods like N2V are limited in their application on new n…
Node ClassificationRepresentation LearningLearning to Extrapolate Knowledge: Transductive Few-shot Out-of-Graph Link Prediction
Many practical graph problems, such as knowledge graph construction and drug-drug interaction prediction, require to handle multi-relational graphs. However, handling real-world multi-relational graphs with Graph Neural …
graph constructionKnowledge Graph CompletionLink PredictionMeta-Learning+1Inductive Link Prediction for Nodes Having Only Attribute Information
Predicting the link between two nodes is a fundamental problem for graph data analytics. In attributed graphs, both the structure and attribute information can be utilized for link prediction. Most existing studies focus…
AttributeInductive Link PredictionLink PredictionPrediction