paper-with-me

Papers

Multi-modal Contrastive Representation Learning for Entity Alignment

2022-09-02 · COLING 2022 10 · Zhenxi Lin, Ziheng Zhang, Meng Wang, Yinghui Shi, Xian Wu, Yefeng Zheng

Multi-modal entity alignment aims to identify equivalent entities between two different multi-modal knowledge graphs, which consist of structural triples and images associated with entities. Most previous works focus on how to utilize and encode information from different modalities, while it is not trivial to leverage multi-modal knowledge in entity alignment because of the modality heterogeneity. In this paper, we propose MCLEA, a Multi-modal Contrastive Learning based Entity Alignment model, to obtain effective joint representations for multi-modal entity alignment. Different from previous works, MCLEA considers task-oriented modality and models the inter-modal relationships for each entity representation. In particular, MCLEA firstly learns multiple individual representations from multiple modalities, and then performs contrastive learning to jointly model intra-modal and inter-modal interactions. Extensive experimental results show that MCLEA outperforms state-of-the-art baselines on public datasets under both supervised and unsupervised settings.

📄 PDF Abstract BibTeX arXiv:2209.00891

Code (1)

lzxlin/mclea 공식 구현 pytorch

Tasks

Contrastive LearningEntity AlignmentKnowledge GraphsMulti-modal Entity AlignmentRepresentation Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

IBMEA: Exploring Variational Information Bottleneck for Multi-modal Entity Alignment

2024-07-27 · Taoyu Su, Jiawei Sheng, Shicheng Wang, Xinghua Zhang 외

Multi-modal entity alignment (MMEA) aims to identify equivalent entities between multi-modal knowledge graphs (MMKGs), where the entities can be associated with related images. Most existing studies integrate multi-modal…

Entity AlignmentKnowledge GraphsMulti-modal Entity Alignment

Leveraging Intra-modal and Inter-modal Interaction for Multi-Modal Entity Alignment

2024-04-19 · Zhiwei Hu, Víctor Gutiérrez-Basulto, Zhiliang Xiang, Ru Li 외

Multi-modal entity alignment (MMEA) aims to identify equivalent entity pairs across different multi-modal knowledge graphs (MMKGs). Existing approaches focus on how to better encode and aggregate information from differe…

Contrastive LearningEntity AlignmentKnowledge GraphsMulti-modal Entity Alignment

Multi-modal Siamese Network for Entity Alignment

2022-08-14 · KDD 2022 8 · Liyi Chen, Zhi Li, Tong Xu, Han Wu 외

The booming of multi-modal knowledge graphs (MMKGs) has raised the imperative demand for multi-modal entity alignment techniques, which facilitate the integration of multiple MMKGs from separate data sources. Unfortunate…

AttributeContrastive LearningEntity AlignmentKnowledge Graphs+2

Pseudo-Label Calibration Semi-supervised Multi-Modal Entity Alignment

2024-03-02 · Luyao Wang, Pengnian Qi, Xigang Bao, Chunlai Zhou 외

Multi-modal entity alignment (MMEA) aims to identify equivalent entities between two multi-modal knowledge graphs for integration. Unfortunately, prior arts have attempted to improve the interaction and fusion of multi-m…

AttributeContrastive LearningEntity AlignmentKnowledge Graphs+2

PSQE: A Theoretical-Practical Approach to Pseudo Seed Quality Enhancement for Unsupervised Multimodal Entity Alignment

2026-02-26 · Yunpeng Hong, Chenyang Bu, Jie Zhang, Yi He 외 arxiv

Multimodal Entity Alignment (MMEA) aims to identify equivalent entities across different data modalities, enabling structural data integration that in turn improves the performance of various large language model applica…

Contrastive LearningEntity Alignment