Sharing Parameter by Conjugation for Knowledge Graph Embeddings in Complex Space
A Knowledge Graph (KG) is the directed graphical representation of entities and relations in the real world. KG can be applied in diverse Natural Language Processing (NLP) tasks where knowledge is required. The need to scale up and complete KG automatically yields Knowledge Graph Embedding (KGE), a shallow machine learning model that is suffering from memory and training time consumption issues. To mitigate the computational load, we propose a parameter-sharing method, i.e., using conjugate parameters for complex numbers employed in KGE models. Our method improves memory efficiency by 2x in relation embedding while achieving comparable performance to the state-of-the-art non-conjugate models, with faster, or at least comparable, training time. We demonstrated the generalizability of our method on two best-performing KGE models $5^{\bigstar}\mathrm{E}$ and $\mathrm{ComplEx}$ on five benchmark datasets.
Code (1)
Tasks
Graph EmbeddingKnowledge Graph EmbeddingKnowledge Graph EmbeddingsSimilar Papers 제목 키워드 기반
KoParadigm: A Korean Conjugation Paradigm Generator
Korean is a morphologically rich language. Korean verbs change their forms in a fickle manner depending on tense, mood, speech level, meaning, etc. Therefore, it is challenging to construct comprehensive conjugation para…
COSINE: Compressive Network Embedding on Large-scale Information Networks
There is recently a surge in approaches that learn low-dimensional embeddings of nodes in networks. As there are many large-scale real-world networks, it's inefficient for existing approaches to store amounts of paramete…
General Classificationgraph partitioningLink PredictionMulti-Label Classification+3Iterative Entity Alignment via Joint Knowledge Embeddings
Entity alignment aims to link entities and their counterparts among multiple knowledge graphs (KGs). Most existing methods typically rely on external information of entities such as Wikipedia links and require costly man…
Entity AlignmentKnowledge Graph CompletionKnowledge GraphsGuidelines for the estimation and reporting of plasmid conjugation rates
Conjugation is a central characteristic of plasmid biology and an important mechanism of horizontal gene transfer in bacteria. However, there is little consensus on how to accurately estimate and report plasmid conjugati…
A Relational Tucker Decomposition for Multi-Relational Link Prediction
We propose the Relational Tucker3 (RT) decomposition for multi-relational link prediction in knowledge graphs. We show that many existing knowledge graph embedding models are special cases of the RT decomposition with ce…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsLink Prediction