paper-with-me

Papers

Complementarity-driven Representation Learning for Multi-modal Knowledge Graph Completion

2025-07-28 · Lijian Li arxiv

Multi-modal Knowledge Graph Completion (MMKGC) aims to uncover hidden world knowledge in multimodal knowledge graphs by leveraging both multimodal and structural entity information. However, the inherent imbalance in multimodal knowledge graphs, where modality distributions vary across entities, poses challenges in utilizing additional modality data for robust entity representation. Existing MMKGC methods typically rely on attention or gate-based fusion mechanisms but overlook complementarity contained in multi-modal data. In this paper, we propose a novel framework named Mixture of Complementary Modality Experts (MoCME), which consists of a Complementarity-guided Modality Knowledge Fusion (CMKF) module and an Entropy-guided Negative Sampling (EGNS) mechanism. The CMKF module exploits both intra-modal and inter-modal complementarity to fuse multi-view and multi-modal embeddings, enhancing representations of entities. Additionally, we introduce an Entropy-guided Negative Sampling mechanism to dynamically prioritize informative and uncertain negative samples to enhance training effectiveness and model robustness. Extensive experiments on five benchmark datasets demonstrate that our MoCME achieves state-of-the-art performance, surpassing existing approaches.

📄 PDF Abstract BibTeX arXiv:2507.20620

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Graph CompletionRepresentation LearningKnowledge Graphs

Similar Papers 제목 키워드 기반

IMF: Interactive Multimodal Fusion Model for Link Prediction

2023-03-20 · Xinhang Li, Xiangyu Zhao, Jiaxing Xu, Yong Zhang 외

Link prediction aims to identify potential missing triples in knowledge graphs. To get better results, some recent studies have introduced multimodal information to link prediction. However, these methods utilize multimo…

Contrastive LearningKnowledge GraphsLink PredictionPrediction

Multi-Modal Object Re-Identification with Prompt-S6 and Semantic-Aware Knowledge Guidance

2026-07-26 · Weixiang Zhou, Jiabei Zuo, Yuhao Wang, Cong Wang 외 arxiv

Multi-modal object Re-Identification (ReID) aims to retrieve specific objects by integrating complementary information from multiple modalities. However, existing multi-modal ReID methods do not effectively address backg…

$R^2$-CoD: Understanding Text-Graph Complementarity in Relational Reasoning via Knowledge Co-Distillation

2025-08-02 · Zhen Wu, Ritam Dutt, Luke M. Breitfeller, Armineh Nourbakhsh 외 arxiv

Relational reasoning lies at the core of many NLP tasks, drawing on complementary signals from text and graphs. While prior research has investigated how to leverage this dual complementarity, a detailed and systematic u…

Relational Reasoning

Complementarity-Preserving Generative Theory for Multimodal ECG Synthesis: A Quantum-Inspired Approach

2026-03-16 · Timothy Oladunni, Farouk Ganiyu-Adewumi, Clyde Baidoo, Kyndal Maclin arxiv

Multimodal deep learning has substantially improved electrocardiogram (ECG) classification by jointly leveraging time, frequency, and time-frequency representations. However, existing generative models typically synthesi…

Multimodal Deep Learning

Complementarity-Supervised Spectral-Band Routing for Multimodal Emotion Recognition

2026-03-07 · Zhexian Huang, Bo Zhao, Hui Ma, Zhishu Liu 외 arxiv

Multimodal emotion recognition fuses cues such as text, video, and audio to understand individual emotional states. Prior methods face two main limitations: mechanically relying on independent unimodal performance, there…

Multimodal Emotion Recognition