paper-with-me

Papers

Universal Multi-modal Entity Alignment via Iteratively Fusing Modality Similarity Paths

2023-10-09 · Bolin Zhu, Xiaoze Liu, Xin Mao, Zhuo Chen, Lingbing Guo, Tao Gui, Qi Zhang

The objective of Entity Alignment (EA) is to identify equivalent entity pairs from multiple Knowledge Graphs (KGs) and create a more comprehensive and unified KG. The majority of EA methods have primarily focused on the structural modality of KGs, lacking exploration of multi-modal information. A few multi-modal EA methods have made good attempts in this field. Still, they have two shortcomings: (1) inconsistent and inefficient modality modeling that designs complex and distinct models for each modality; (2) ineffective modality fusion due to the heterogeneous nature of modalities in EA. To tackle these challenges, we propose PathFusion, consisting of two main components: (1) MSP, a unified modeling approach that simplifies the alignment process by constructing paths connecting entities and modality nodes to represent multiple modalities; (2) IRF, an iterative fusion method that effectively combines information from different modalities using the path as an information carrier. Experimental results on real-world datasets demonstrate the superiority of PathFusion over state-of-the-art methods, with 22.4%-28.9% absolute improvement on Hits@1, and 0.194-0.245 absolute improvement on MRR.

📄 PDF Abstract BibTeX arXiv:2310.05364

Code (1)

blzhu0823/pathfusion 공식 구현 pytorch

Tasks

Entity AlignmentKnowledge GraphsMulti-modal Entity Alignment

Similar Papers 제목 키워드 기반

Multi-modal Contrastive Representation Learning for Entity Alignment

2022-09-02 · COLING 2022 10 · Zhenxi Lin, Ziheng Zhang, Meng Wang, Yinghui Shi 외

Multi-modal entity alignment aims to identify equivalent entities between two different multi-modal knowledge graphs, which consist of structural triples and images associated with entities. Most previous works focus on …

Contrastive LearningEntity AlignmentKnowledge GraphsMulti-modal Entity Alignment+1

Towards Semantic Consistency: Dirichlet Energy Driven Robust Multi-Modal Entity Alignment

2024-01-31 · Yuanyi Wang, Haifeng Sun, Jiabo Wang, Jingyu Wang 외

In Multi-Modal Knowledge Graphs (MMKGs), Multi-Modal Entity Alignment (MMEA) is crucial for identifying identical entities across diverse modal attributes. However, semantic inconsistency, mainly due to missing modal att…

AttributeEntity AlignmentGraph LearningKnowledge Graphs+2

IBMEA: Exploring Variational Information Bottleneck for Multi-modal Entity Alignment

2024-07-27 · Taoyu Su, Jiawei Sheng, Shicheng Wang, Xinghua Zhang 외

Multi-modal entity alignment (MMEA) aims to identify equivalent entities between multi-modal knowledge graphs (MMKGs), where the entities can be associated with related images. Most existing studies integrate multi-modal…

Entity AlignmentKnowledge GraphsMulti-modal Entity Alignment

Attribute-Consistent Knowledge Graph Representation Learning for Multi-Modal Entity Alignment

2023-04-04 · Qian Li, Shu Guo, Yangyifei Luo, Cheng Ji 외

The multi-modal entity alignment (MMEA) aims to find all equivalent entity pairs between multi-modal knowledge graphs (MMKGs). Rich attributes and neighboring entities are valuable for the alignment task, but existing wo…

AttributeEntity AlignmentGraph Neural NetworkGraph Representation Learning+4

MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybrid

2022-12-29 · Zhuo Chen, Jiaoyan Chen, Wen Zhang, Lingbing Guo 외

Multi-modal entity alignment (MMEA) aims to discover identical entities across different knowledge graphs (KGs) whose entities are associated with relevant images. However, current MMEA algorithms rely on KG-level modali…

Entity AlignmentKnowledge GraphsMulti-modal Entity Alignment