Knowledge Graph Embedding by Translating on Hyperplanes
We deal with embedding a large scale knowledge graph composed of entities and relations into a continuous vector space. TransE is a promising method proposed recently, which is very efficient while achieving state-of-the-art predictive performance. We discuss some mapping properties of relations which should be considered in embedding, such as reflexive, one-to-many, many-to-one, and many-to-many. We note that TransE does not do well in dealing with these properties. Some complex models are capable of preserving these mapping properties but sacrifice efficiency in the process. To make a good trade-off between model capacity and efficiency, in this paper we propose TransH which models a relation as a hyperplane together with a translation operation on it. In this way, we can well preserve the above mapping properties of relations with almost the same model complexity of TransE. Additionally, as a practical knowledge graph is often far from completed, how to construct negative examples to reduce false negative labels in training is very important. Utilizing the one-to-many/many-to-one mapping property of a relation, we propose a simple trick to reduce the possibility of false negative labeling. We conduct extensive experiments on link prediction, triplet classification and fact extraction on benchmark datasets like WordNet and Freebase. Experiments show TransH delivers significant improvements over TransE on predictive accuracy with comparable capability to scale up.
Code (1)
Tasks
Graph EmbeddingKnowledge Graph EmbeddingLink PredictionTripletSimilar Papers 제목 키워드 기반
Efficient Parallel Translating Embedding For Knowledge Graphs
Knowledge graph embedding aims to embed entities and relations of knowledge graphs into low-dimensional vector spaces. Translating embedding methods regard relations as the translation from head entities to tail entities…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsLink Prediction+1RatE: Relation-Adaptive Translating Embedding for Knowledge Graph Completion
Many graph embedding approaches have been proposed for knowledge graph completion via link prediction. Among those, translating embedding approaches enjoy the advantages of light-weight structure, high efficiency and gre…
Graph EmbeddingKnowledge Graph CompletionLink PredictionRelation+1ParaGraphE: A Library for Parallel Knowledge Graph Embedding
Knowledge graph embedding aims at translating the knowledge graph into numerical representations by transforming the entities and relations into continuous low-dimensional vectors. Recently, many methods [1, 5, 3, 2, 6] …
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsAdversarial Contrastive Estimation
Learning by contrasting positive and negative samples is a general strategy adopted by many methods. Noise contrastive estimation (NCE) for word embeddings and translating embeddings for knowledge graphs are examples in …
Contrastive LearningKnowledge Graph EmbeddingsKnowledge GraphsLearning Word Embeddings+1TransEdge: Translating Relation-contextualized Embeddings for Knowledge Graphs
Learning knowledge graph (KG) embeddings has received increasing attention in recent years. Most embedding models in literature interpret relations as linear or bilinear mapping functions to operate on entity embeddings.…
Entity AlignmentEntity EmbeddingsKnowledge GraphsLink Prediction+1