Knowledge Graph Representation with Jointly Structural and Textual Encoding
The objective of knowledge graph embedding is to encode both entities and relations of knowledge graphs into continuous low-dimensional vector spaces. Previously, most works focused on symbolic representation of knowledge graph with structure information, which can not handle new entities or entities with few facts well. In this paper, we propose a novel deep architecture to utilize both structural and textual information of entities. Specifically, we introduce three neural models to encode the valuable information from text description of entity, among which an attentive model can select related information as needed. Then, a gating mechanism is applied to integrate representations of structure and text into a unified architecture. Experiments show that our models outperform baseline by margin on link prediction and triplet classification tasks. Source codes of this paper will be available on Github.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationGraph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsLink PredictionTripletSimilar Papers 제목 키워드 기반
Knowledge Graph-Infused Fine-Tuning for Structured Reasoning in Large Language Models
This paper addresses the problems of missing reasoning chains and insufficient entity-level semantic understanding in large language models when dealing with tasks that require structured knowledge. It proposes a fine-tu…
Graph Neural NetworkQuestion AnsweringIntegrating Knowledge Graph embedding and pretrained Language Models in Hypercomplex Spaces
Knowledge Graphs, such as Wikidata, comprise structural and textual knowledge in order to represent knowledge. For each of the two modalities dedicated approaches for graph embedding and language models learn patterns th…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsLink Prediction+1Joint Embedding Learning of Educational Knowledge Graphs
As an efficient model for knowledge organization, the knowledge graph has been widely adopted in several fields, e.g., biomedicine, sociology, and education. And there is a steady trend of learning embedding representati…
General Knowledgegraph constructionGraph EmbeddingKnowledge Graph Embedding+2Improving Knowledge Graph Representation Learning by Structure Contextual Pre-training
Representation learning models for Knowledge Graphs (KG) have proven to be effective in encoding structural information and performing reasoning over KGs. In this paper, we propose a novel pre-training-then-fine-tuning f…
Entity AlignmentGraph Representation LearningKnowledge GraphsRepresentation Learning+2Towards Bridging Review Sparsity in Recommendation with Textual Edge Graph Representation
Textual reviews enrich recommender systems with fine-grained preference signals and enhanced explainability. However, in real-world scenarios, users rarely leave reviews, resulting in severe sparsity that undermines the …