Inductive Relation Prediction by BERT
Relation prediction in knowledge graphs is dominated by embedding based methods which mainly focus on the transductive setting. Unfortunately, they are not able to handle inductive learning where unseen entities and relations are present and cannot take advantage of prior knowledge. Furthermore, their inference process is not easily explainable. In this work, we propose an all-in-one solution, called BERTRL (BERT-based Relational Learning), which leverages pre-trained language model and fine-tunes it by taking relation instances and their possible reasoning paths as training samples. BERTRL outperforms the SOTAs in 15 out of 18 cases in both inductive and transductive settings. Meanwhile, it demonstrates strong generalization capability in few-shot learning and is explainable.
Code (1)
Tasks
Few-Shot LearningInductive LearningInductive Relation PredictionKnowledge GraphsLanguage ModelingLanguage ModellingPredictionRelationRelational ReasoningRelation PredictionSimilar Papers 제목 키워드 기반
Incorporating Structured Sentences with Time-enhanced BERT for Fully-inductive Temporal Relation Prediction
Temporal relation prediction in incomplete temporal knowledge graphs (TKGs) is a popular temporal knowledge graph completion (TKGC) problem in both transductive and inductive settings. Traditional embedding-based TKGC mo…
Knowledge Graph CompletionKnowledge GraphsRelationRelation Prediction+1Bi-Link: Bridging Inductive Link Predictions from Text via Contrastive Learning of Transformers and Prompts
Inductive knowledge graph completion requires models to comprehend the underlying semantics and logic patterns of relations. With the advance of pretrained language models, recent research have designed transformers for …
Contrastive LearningEntity LinkingInductive knowledge graph completionKnowledge Graph Completion+3ExpBERT: Representation Engineering with Natural Language Explanations
Suppose we want to specify the inductive bias that married couples typically go on honeymoons for the task of extracting pairs of spouses from text. In this paper, we allow model developers to specify these types of indu…
Inductive BiasRelation ExtractionSentenceTopology-Aware Correlations Between Relations for Inductive Link Prediction in Knowledge Graphs
Inductive link prediction -- where entities during training and inference stages can be different -- has been shown to be promising for completing continuously evolving knowledge graphs. Existing models of inductive reas…
Inductive Link PredictionKnowledge GraphsLink PredictionPrediction+1Towards Few-shot Inductive Link Prediction on Knowledge Graphs: A Relational Anonymous Walk-guided Neural Process Approach
Few-shot inductive link prediction on knowledge graphs (KGs) aims to predict missing links for unseen entities with few-shot links observed. Previous methods are limited to transductive scenarios, where entities exist in…
Inductive Link PredictionKnowledge GraphsLink PredictionPrediction