paper-with-me

Papers

MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignment

2024-10-18 · Wei Ai, Wen Deng, Hongyi Chen, JiaYi Du, Tao Meng, Yuntao Shou

Multi-modal entity alignment (MMEA) is essential for enhancing knowledge graphs and improving information retrieval and question-answering systems. Existing methods often focus on integrating modalities through their complementarity but overlook the specificity of each modality, which can obscure crucial features and reduce alignment accuracy. To solve this, we propose the Multi-modal Consistency and Specificity Fusion Framework (MCSFF), which innovatively integrates both complementary and specific aspects of modalities. We utilize Scale Computing's hyper-converged infrastructure to optimize IT management and resource allocation in large-scale data processing. Our framework first computes similarity matrices for each modality using modality embeddings to preserve their unique characteristics. Then, an iterative update method denoises and enhances modality features to fully express critical information. Finally, we integrate the updated information from all modalities to create enriched and precise entity representations. Experiments show our method outperforms current state-of-the-art MMEA baselines on the MMKG dataset, demonstrating its effectiveness and practical potential.

📄 PDF Abstract BibTeX arXiv:2410.14584

Code (0)

등록된 구현이 없습니다.

Tasks

Entity AlignmentInformation RetrievalKnowledge GraphsManagementMulti-modal Entity AlignmentQuestion AnsweringSpecificity

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Object Segmentation by Mining Cross-Modal Semantics

2023-05-17 · Zongwei Wu, Jingjing Wang, Zhuyun Zhou, Zhaochong An 외

Multi-sensor clues have shown promise for object segmentation, but inherent noise in each sensor, as well as the calibration error in practice, may bias the segmentation accuracy. In this paper, we propose a novel approa…

DecoderObjectSegmentationSemantic Segmentation+1

Fair-Eye Net: A Fair, Trustworthy, Multimodal Integrated Glaucoma Full Chain AI System

2026-01-26 · Wenbin Wei, Suyuan Yao, Cheng Huang, Xiangyu Gao arxiv

Glaucoma is a top cause of irreversible blindness globally, making early detection and longitudinal follow-up pivotal to preventing permanent vision loss. Current screening and progression assessment, however, rely on si…

WD-FQDet: Multispectral Detection Transformer via Wavelet Decomposition and Frequency-aware Query Learning

2026-05-13 · Chunjin Yang, Xiwei Zhang, Yiming Xiao, Fanman Meng arxiv

Infrared-visible object detection improves detection performance by combining complementary features from multispectral images. Existing backbone-specific and backbone-shared approaches still suffer from the problems of …

Object Detection

WebGuard++:Interpretable Malicious URL Detection via Bidirectional Fusion of HTML Subgraphs and Multi-Scale Convolutional BERT

2025-06-24 · Ye Tian, Zhang Yumin, Yifan Jia, Jianguo Sun 외

URL+HTML feature fusion shows promise for robust malicious URL detection, since attacker artifacts persist in DOM structures. However, prior work suffers from four critical shortcomings: (1) incomplete URL modeling, fail…

Contrastive LearningSpecificity

Specificity-preserving RGB-D Saliency Detection

2021-08-18 · ICCV 2021 10 · Tao Zhou, Deng-Ping Fan, Geng Chen, Yi Zhou 외

Salient object detection (SOD) on RGB and depth images has attracted more and more research interests, due to its effectiveness and the fact that depth cues can now be conveniently captured. Existing RGB-D SOD models usu…

Decoderobject-detectionObject DetectionSaliency Detection+4