KG-BERT: BERT for Knowledge Graph Completion
Knowledge graphs are important resources for many artificial intelligence tasks but often suffer from incompleteness. In this work, we propose to use pre-trained language models for knowledge graph completion. We treat triples in knowledge graphs as textual sequences and propose a novel framework named Knowledge Graph Bidirectional Encoder Representations from Transformer (KG-BERT) to model these triples. Our method takes entity and relation descriptions of a triple as input and computes scoring function of the triple with the KG-BERT language model. Experimental results on multiple benchmark knowledge graphs show that our method can achieve state-of-the-art performance in triple classification, link prediction and relation prediction tasks.
Code (3)
Tasks
Knowledge Graph CompletionKnowledge GraphsLanguage ModelingLanguage ModellingLink PredictionPredictionRelationRelation PredictionTriple ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CEAR: Cross-Entity Aware Reranker for Knowledge Base Completion
Pre-trained language models (LMs) like BERT have shown to store factual knowledge about the world. This knowledge can be used to augment the information present in Knowledge Bases, which tend to be incomplete. However, p…
Knowledge Base CompletionLink PredictionTriple Classification for Scholarly Knowledge Graph Completion
Scholarly Knowledge Graphs (KGs) provide a rich source of structured information representing knowledge encoded in scientific publications. With the sheer volume of published scientific literature comprising a plethora o…
ClassificationKnowledge Graph CompletionKnowledge GraphsLink Prediction+2Multi-Task Learning for Knowledge Graph Completion with Pre-trained Language Models
As research on utilizing human knowledge in natural language processing has attracted considerable attention in recent years, knowledge graph (KG) completion has come into the spotlight. Recently, a new knowledge graph c…
Knowledge Graph CompletionKnowledge GraphsLanguage ModelingLanguage Modelling+3Knowledge Graph Refinement based on Triplet BERT-Networks
Knowledge graph embedding techniques are widely used for knowledge graph refinement tasks such as graph completion and triple classification. These techniques aim at embedding the entities and relations of a Knowledge Gr…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsRelation+3Learning Physical Common Sense as Knowledge Graph Completion via BERT Data Augmentation and Constrained Tucker Factorization
Physical common sense plays an essential role in the cognition abilities of robots for human-robot interaction. Machine learning methods have shown promising results on physical commonsense learning in natural language p…
Common Sense ReasoningData AugmentationGeneral KnowledgeGraph Embedding+5