Scaling Knowledge Graph Embedding Models
Developing scalable solutions for training Graph Neural Networks (GNNs) for link prediction tasks is challenging due to the high data dependencies which entail high computational cost and huge memory footprint. We propose a new method for scaling training of knowledge graph embedding models for link prediction to address these challenges. Towards this end, we propose the following algorithmic strategies: self-sufficient partitions, constraint-based negative sampling, and edge mini-batch training. Both, partitioning strategy and constraint-based negative sampling, avoid cross partition data transfer during training. In our experimental evaluation, we show that our scaling solution for GNN-based knowledge graph embedding models achieves a 16x speed up on benchmark datasets while maintaining a comparable model performance as non-distributed methods on standard metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph EmbeddingKnowledge Graph EmbeddingLink PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
STaR: Knowledge Graph Embedding by Scaling, Translation and Rotation
The bilinear method is mainstream in Knowledge Graph Embedding (KGE), aiming to learn low-dimensional representations for entities and relations in Knowledge Graph (KG) and complete missing links. Most of the existing wo…
Graph EmbeddingKnowledge Graph EmbeddingLink PredictionTranslationSTaR: Knowledge Graph Embedding by Scaling, Translation and Rotation
The bilinear method is mainstream in Knowledge Graph Embedding (KGE), aiming to learn low-dimensional representations for entities and relations in Knowledge Graph (KG) and complete missing links. Most of the existing wo…
Graph EmbeddingKnowledge Graph EmbeddingLink PredictionTranslationCompoundE: Knowledge Graph Embedding with Translation, Rotation and Scaling Compound Operations
Translation, rotation, and scaling are three commonly used geometric manipulation operations in image processing. Besides, some of them are successfully used in developing effective knowledge graph embedding (KGE) models…
Graph EmbeddingKnowledge Graph EmbeddingRelationTranslationPretrained Knowledge Base Embeddings for improved Sentential Relation Extraction
In this work we put forward to combine pretrained knowledge base graph embeddings with transformer based language models to improve performance on the sentential Relation Extraction task in natural language processing. O…
RelationRelation ExtractionProbability Calibration for Knowledge Graph Embedding Models
Knowledge graph embedding research has overlooked the problem of probability calibration. We show popular embedding models are indeed uncalibrated. That means probability estimates associated to predicted triples are unr…
Calibration for Link PredictionGraph EmbeddingKnowledge Graph EmbeddingKnowledge Graphs+1