Multi-modal Contrastive Representation Learning for Entity Alignment
Multi-modal entity alignment aims to identify equivalent entities between two different multi-modal knowledge graphs, which consist of structural triples and images associated with entities. Most previous works focus on how to utilize and encode information from different modalities, while it is not trivial to leverage multi-modal knowledge in entity alignment because of the modality heterogeneity. In this paper, we propose MCLEA, a Multi-modal Contrastive Learning based Entity Alignment model, to obtain effective joint representations for multi-modal entity alignment. Different from previous works, MCLEA considers task-oriented modality and models the inter-modal relationships for each entity representation. In particular, MCLEA firstly learns multiple individual representations from multiple modalities, and then performs contrastive learning to jointly model intra-modal and inter-modal interactions. Extensive experimental results show that MCLEA outperforms state-of-the-art baselines on public datasets under both supervised and unsupervised settings.
Code (1)
Tasks
Contrastive LearningEntity AlignmentKnowledge GraphsMulti-modal Entity AlignmentRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
IBMEA: Exploring Variational Information Bottleneck for Multi-modal Entity Alignment
Multi-modal entity alignment (MMEA) aims to identify equivalent entities between multi-modal knowledge graphs (MMKGs), where the entities can be associated with related images. Most existing studies integrate multi-modal…
Entity AlignmentKnowledge GraphsMulti-modal Entity AlignmentLeveraging Intra-modal and Inter-modal Interaction for Multi-Modal Entity Alignment
Multi-modal entity alignment (MMEA) aims to identify equivalent entity pairs across different multi-modal knowledge graphs (MMKGs). Existing approaches focus on how to better encode and aggregate information from differe…
Contrastive LearningEntity AlignmentKnowledge GraphsMulti-modal Entity AlignmentMulti-modal Siamese Network for Entity Alignment
The booming of multi-modal knowledge graphs (MMKGs) has raised the imperative demand for multi-modal entity alignment techniques, which facilitate the integration of multiple MMKGs from separate data sources. Unfortunate…
AttributeContrastive LearningEntity AlignmentKnowledge Graphs+2Pseudo-Label Calibration Semi-supervised Multi-Modal Entity Alignment
Multi-modal entity alignment (MMEA) aims to identify equivalent entities between two multi-modal knowledge graphs for integration. Unfortunately, prior arts have attempted to improve the interaction and fusion of multi-m…
AttributeContrastive LearningEntity AlignmentKnowledge Graphs+2PSQE: A Theoretical-Practical Approach to Pseudo Seed Quality Enhancement for Unsupervised Multimodal Entity Alignment
Multimodal Entity Alignment (MMEA) aims to identify equivalent entities across different data modalities, enabling structural data integration that in turn improves the performance of various large language model applica…
Contrastive LearningEntity Alignment