Learning to Extrapolate Knowledge: Transductive Few-shot Out-of-Graph Link Prediction
Many practical graph problems, such as knowledge graph construction and drug-drug interaction prediction, require to handle multi-relational graphs. However, handling real-world multi-relational graphs with Graph Neural Networks (GNNs) is often challenging due to their evolving nature, as new entities (nodes) can emerge over time. Moreover, newly emerged entities often have few links, which makes the learning even more difficult. Motivated by this challenge, we introduce a realistic problem of few-shot out-of-graph link prediction, where we not only predict the links between the seen and unseen nodes as in a conventional out-of-knowledge link prediction task but also between the unseen nodes, with only few edges per node. We tackle this problem with a novel transductive meta-learning framework which we refer to as Graph Extrapolation Networks (GEN). GEN meta-learns both the node embedding network for inductive inference (seen-to-unseen) and the link prediction network for transductive inference (unseen-to-unseen). For transductive link prediction, we further propose a stochastic embedding layer to model uncertainty in the link prediction between unseen entities. We validate our model on multiple benchmark datasets for knowledge graph completion and drug-drug interaction prediction. The results show that our model significantly outperforms relevant baselines for out-of-graph link prediction tasks.
Code (1)
Tasks
graph constructionKnowledge Graph CompletionLink PredictionMeta-LearningPredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning Meta Representations of One-shot Relations for Temporal Knowledge Graph Link Prediction
Few-shot relational learning for static knowledge graphs (KGs) has drawn greater interest in recent years, while few-shot learning for temporal knowledge graphs (TKGs) has hardly been studied. Compared to KGs, TKGs conta…
Few-Shot LearningKnowledge GraphsLink PredictionRelational ReasoningTowards Few-shot Inductive Link Prediction on Knowledge Graphs: A Relational Anonymous Walk-guided Neural Process Approach
Few-shot inductive link prediction on knowledge graphs (KGs) aims to predict missing links for unseen entities with few-shot links observed. Previous methods are limited to transductive scenarios, where entities exist in…
Inductive Link PredictionKnowledge GraphsLink PredictionPredictionA Benchmark for Semi-Inductive Link Prediction in Knowledge Graphs
Semi-inductive link prediction (LP) in knowledge graphs (KG) is the task of predicting facts for new, previously unseen entities based on context information. Although new entities can be integrated by retraining the mod…
Inductive Link PredictionKnowledge GraphsLink PredictionKnown Unknowns: Out-of-Distribution Property Prediction in Materials and Molecules
Discovery of high-performance materials and molecules requires identifying extremes with property values that fall outside the known distribution. Therefore, the ability to extrapolate to out-of-distribution (OOD) proper…
Known UnknownsProperty PredictionSubgraph-aware Few-Shot Inductive Link Prediction via Meta-Learning
Link prediction for knowledge graphs aims to predict missing connections between entities. Prevailing methods are limited to a transductive setting and hard to process unseen entities. The recent proposed subgraph-based …
Inductive Link PredictionKnowledge GraphsLink PredictionMeta-Learning+2