paper-with-me

Papers

MMEA: Entity Alignment for Multi-Modal Knowledge Graphs

2020-08-20 · Liyi Chen, Zhi Li, Yijun Wang, Tong Xu, Zhefeng Wang, Enhong Chen

Entity alignment plays an essential role in the knowledge graph (KG) integration. Though large efforts have been made on exploring the association of relational embeddings between different knowledge graphs, they may fail to effectively describe and integrate the multimodal knowledge in the real application scenario. To that end, in this paper, we propose a novel solution called Multi-Modal Entity Alignment (MMEA) to address the problem of entity alignment in a multi-modal view. Specifically, we first design a novel multi-modal knowledge embedding method to generate the entity representations of relational, visual and numerical knowledge, respectively. Along this line, multiple representations of different types of knowledge will be integrated via a multimodal knowledge fusion module. Extensive experiments on two public datasets clearly demonstrate the effectiveness of the MMEA model with a significant margin compared with the state-of-the-art methods.

📄 PDF Abstract BibTeX

Code (1)

liyichen-cly/MMEA 공식 구현 tf

Tasks

Entity AlignmentKnowledge GraphsMultimodal Deep LearningMulti-modal Entity Alignment

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Ethereum Customer Service Number +1-833-534-1729 설명 없음
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Attribute-Consistent Knowledge Graph Representation Learning for Multi-Modal Entity Alignment

2023-04-04 · Qian Li, Shu Guo, Yangyifei Luo, Cheng Ji 외

The multi-modal entity alignment (MMEA) aims to find all equivalent entity pairs between multi-modal knowledge graphs (MMKGs). Rich attributes and neighboring entities are valuable for the alignment task, but existing wo…

AttributeEntity AlignmentGraph Neural NetworkGraph Representation Learning+4

IBMEA: Exploring Variational Information Bottleneck for Multi-modal Entity Alignment

2024-07-27 · Taoyu Su, Jiawei Sheng, Shicheng Wang, Xinghua Zhang 외

Multi-modal entity alignment (MMEA) aims to identify equivalent entities between multi-modal knowledge graphs (MMKGs), where the entities can be associated with related images. Most existing studies integrate multi-modal…

Entity AlignmentKnowledge GraphsMulti-modal Entity Alignment

Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignment

2023-07-30 · Zhuo Chen, Lingbing Guo, Yin Fang, Yichi Zhang 외

As a crucial extension of entity alignment (EA), multi-modal entity alignment (MMEA) aims to identify identical entities across disparate knowledge graphs (KGs) by exploiting associated visual information. However, exist…

BenchmarkingEntity AlignmentKnowledge Graph EmbeddingsKnowledge Graphs+1

MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybrid

2022-12-29 · Zhuo Chen, Jiaoyan Chen, Wen Zhang, Lingbing Guo 외

Multi-modal entity alignment (MMEA) aims to discover identical entities across different knowledge graphs (KGs) whose entities are associated with relevant images. However, current MMEA algorithms rely on KG-level modali…

Entity AlignmentKnowledge GraphsMulti-modal Entity Alignment

Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignment

2023-10-10 · Qian Li, Cheng Ji, Shu Guo, Zhaoji Liang 외

Multi-Modal Entity Alignment (MMEA) is a critical task that aims to identify equivalent entity pairs across multi-modal knowledge graphs (MMKGs). However, this task faces challenges due to the presence of different types…

Entity AlignmentKnowledge GraphsMulti-modal Entity AlignmentMulti-modal Knowledge Graph