ReadE: Learning Relation-Dependent Entity Representation for Knowledge Graph Completion
Conventional knowledge graph embedding methods learn semantic representations for entities considering their intrinsic interactions through powerful graph neural networks. However, previous methods represent each node solely with a coarse-grained unique representation, regardless of the variance of emphasis of entity semantics by different relations. To tackle this problem, we propose ReadE, a method to learn relation-dependent entity representations of which the semantic information is emphasized by varied relations types. First, we propose a relation-controlled gating mechanism targeting on utilizing the relation to control the information flow in the aggregation step of the graph neural network. Second, we propose a contrastive learning method with mixing both relation-level and entity-level negative samples to enhance semantics preserved in relation-dependent entity representations. Experiments on three benchmarks show that our proposed model outperforms all strong baselines. The code will be made open-sourced on Github.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningGraph EmbeddingGraph Neural NetworkKnowledge Graph CompletionKnowledge Graph EmbeddingRelationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Grape: Knowledge Graph Enhanced Passage Reader for Open-domain Question Answering
A common thread of open-domain question answering (QA) models employs a retriever-reader pipeline that first retrieves a handful of relevant passages from Wikipedia and then peruses the passages to produce an answer. How…
Entity EmbeddingsGraph Neural NetworkOpen-Domain Question AnsweringQuestion AnsweringReLiK: Retrieve and LinK, Fast and Accurate Entity Linking and Relation Extraction on an Academic Budget
Entity Linking (EL) and Relation Extraction (RE) are fundamental tasks in Natural Language Processing, serving as critical components in a wide range of applications. In this paper, we propose ReLiK, a Retriever-Reader a…
Document-level Closed Information ExtractionEntity LinkingRelation ExtractionBidirectional End-to-End Learning of Retriever-Reader Paradigm for Entity Linking
Entity Linking (EL) is a fundamental task for Information Extraction and Knowledge Graphs. The general form of EL (i.e., end-to-end EL) aims to first find mentions in the given input document and then link the mentions t…
Entity LinkingEntity RetrievalKnowledge GraphsMachine Reading Comprehension+2A Review of Knowledge Graph Completion
Information extraction methods proved to be effective at triple extraction from structured or unstructured data. The organization of such triples in the form of (head entity, relation, tail entity) is called the construc…
Graph Neural NetworkKnowledge Graph CompletionKnowledge GraphsRepresentation LearningA2N: Attending to Neighbors for Knowledge Graph Inference
State-of-the-art models for knowledge graph completion aim at learning a fixed embedding representation of entities in a multi-relational graph which can generalize to infer unseen entity relationships at test time. This…
Knowledge Graph CompletionLink Prediction