paper-with-me

Papers

Inductive Relation Prediction by BERT

2021-03-12 · Hanwen Zha, Zhiyu Chen, Xifeng Yan

Relation prediction in knowledge graphs is dominated by embedding based methods which mainly focus on the transductive setting. Unfortunately, they are not able to handle inductive learning where unseen entities and relations are present and cannot take advantage of prior knowledge. Furthermore, their inference process is not easily explainable. In this work, we propose an all-in-one solution, called BERTRL (BERT-based Relational Learning), which leverages pre-trained language model and fine-tunes it by taking relation instances and their possible reasoning paths as training samples. BERTRL outperforms the SOTAs in 15 out of 18 cases in both inductive and transductive settings. Meanwhile, it demonstrates strong generalization capability in few-shot learning and is explainable.

📄 PDF Abstract BibTeX arXiv:2103.07102

Code (1)

zhw12/BERTRL 공식 구현 pytorch

Tasks

Few-Shot LearningInductive LearningInductive Relation PredictionKnowledge GraphsLanguage ModelingLanguage ModellingPredictionRelationRelational ReasoningRelation Prediction

Similar Papers 제목 키워드 기반

Incorporating Structured Sentences with Time-enhanced BERT for Fully-inductive Temporal Relation Prediction

2023-04-10 · Zhongwu Chen, Chengjin Xu, Fenglong Su, Zhen Huang 외

Temporal relation prediction in incomplete temporal knowledge graphs (TKGs) is a popular temporal knowledge graph completion (TKGC) problem in both transductive and inductive settings. Traditional embedding-based TKGC mo…

Knowledge Graph CompletionKnowledge GraphsRelationRelation Prediction+1

Bi-Link: Bridging Inductive Link Predictions from Text via Contrastive Learning of Transformers and Prompts

2022-10-26 · Bohua Peng, Shihao Liang, Mobarakol Islam

Inductive knowledge graph completion requires models to comprehend the underlying semantics and logic patterns of relations. With the advance of pretrained language models, recent research have designed transformers for …

Contrastive LearningEntity LinkingInductive knowledge graph completionKnowledge Graph Completion+3

ExpBERT: Representation Engineering with Natural Language Explanations

2020-05-05 · ACL 2020 6 · Shikhar Murty, Pang Wei Koh, Percy Liang

Suppose we want to specify the inductive bias that married couples typically go on honeymoons for the task of extracting pairs of spouses from text. In this paper, we allow model developers to specify these types of indu…

Inductive BiasRelation ExtractionSentence

Topology-Aware Correlations Between Relations for Inductive Link Prediction in Knowledge Graphs

2021-03-05 · Jiajun Chen, Huarui He, Feng Wu, Jie Wang

Inductive link prediction -- where entities during training and inference stages can be different -- has been shown to be promising for completing continuously evolving knowledge graphs. Existing models of inductive reas…

Inductive Link PredictionKnowledge GraphsLink PredictionPrediction+1

Towards Few-shot Inductive Link Prediction on Knowledge Graphs: A Relational Anonymous Walk-guided Neural Process Approach

2023-06-26 · Zicheng Zhao, Linhao Luo, Shirui Pan, Quoc Viet Hung Nguyen 외

Few-shot inductive link prediction on knowledge graphs (KGs) aims to predict missing links for unseen entities with few-shot links observed. Previous methods are limited to transductive scenarios, where entities exist in…

Inductive Link PredictionKnowledge GraphsLink PredictionPrediction