paper-with-me

Papers

MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybrid

2022-12-29 · Zhuo Chen, Jiaoyan Chen, Wen Zhang, Lingbing Guo, Yin Fang, Yufeng Huang, Yichi Zhang, Yuxia Geng, Jeff Z. Pan, Wenting Song, Huajun Chen

Multi-modal entity alignment (MMEA) aims to discover identical entities across different knowledge graphs (KGs) whose entities are associated with relevant images. However, current MMEA algorithms rely on KG-level modality fusion strategies for multi-modal entity representation, which ignores the variations of modality preferences of different entities, thus compromising robustness against noise in modalities such as blurry images and relations. This paper introduces MEAformer, a multi-modal entity alignment transformer approach for meta modality hybrid, which dynamically predicts the mutual correlation coefficients among modalities for more fine-grained entity-level modality fusion and alignment. Experimental results demonstrate that our model not only achieves SOTA performance in multiple training scenarios, including supervised, unsupervised, iterative, and low-resource settings, but also has a limited number of parameters, efficient runtime, and interpretability. Our code is available at https://github.com/zjukg/MEAformer.

📄 PDF Abstract BibTeX arXiv:2212.14454

Code (1)

zjukg/MEAformer 공식 구현 pytorch

Tasks

Entity AlignmentKnowledge GraphsMulti-modal Entity Alignment

Methods 이 논문이 사용한 방법론

GAT A Graph Attention Network (GAT) is a neural network architecture that operates on graph-structured data, leveraging masked self-attentional layers to address the shortcomings…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Accurate and Robust Lesion RECIST Diameter Prediction and Segmentation with Transformers

2022-08-28 · YouBao Tang, Ning Zhang, Yirui Wang, Shenghua He 외

Automatically measuring lesion/tumor size with RECIST (Response Evaluation Criteria In Solid Tumors) diameters and segmentation is important for computer-aided diagnosis. Although it has been studied in recent years, the…

Lesion SegmentationPredictionregressionSegmentation

Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignment

2023-10-10 · Qian Li, Cheng Ji, Shu Guo, Zhaoji Liang 외

Multi-Modal Entity Alignment (MMEA) is a critical task that aims to identify equivalent entity pairs across multi-modal knowledge graphs (MMKGs). However, this task faces challenges due to the presence of different types…

Entity AlignmentKnowledge GraphsMulti-modal Entity AlignmentMulti-modal Knowledge Graph

MyGram: Modality-aware Graph Transformer with Global Distribution for Multi-modal Entity Alignment

2026-01-17 · Zhifei Li, Ziyue Qin, Xiangyu Luo, Xiaoju Hou 외 arxiv

Multi-modal entity alignment aims to identify equivalent entities between two multi-modal Knowledge graphs by integrating multi-modal data, such as images and text, to enrich the semantic representations of entities. How…

Multi-modal Entity AlignmentKnowledge Graphs

Align and Prompt: Video-and-Language Pre-training with Entity Prompts

2021-12-17 · CVPR 2022 1 · Dongxu Li, Junnan Li, Hongdong Li, Juan Carlos Niebles 외

Video-and-language pre-training has shown promising improvements on various downstream tasks. Most previous methods capture cross-modal interactions with a transformer-based multimodal encoder, not fully addressing the m…

cross-modal alignmentEntity AlignmentRetrievalVideo Retrieval+2

UniTranSeR: A Unified Transformer Semantic Representation Framework for Multimodal Task-Oriented Dialog System

2022-05-01 · ACL 2022 5 · Zhiyuan Ma, Jianjun Li, GuoHui Li, Yongjing Cheng

As a more natural and intelligent interaction manner, multimodal task-oriented dialog system recently has received great attention and many remarkable progresses have been achieved. Nevertheless, almost all existing stud…

Entity Alignment