paper-with-me

홈 › Papers

Multimodal Graph Neural Network for Recommendation with Dynamic De-redundancy and Modality-Guided Feature De-noisy

2024-11-03 · Feng Mo, Lin Xiao, Qiya Song, Xieping Gao, Eryao Liang

Graph neural networks (GNNs) have become crucial in multimodal recommendation tasks because of their powerful ability to capture complex relationships between neighboring nodes. However, increasing the number of propagation layers in GNNs can lead to feature redundancy, which may negatively impact the overall recommendation performance. In addition, the existing recommendation task method directly maps the preprocessed multimodal features to the low-dimensional space, which will bring the noise unrelated to user preference, thus affecting the representation ability of the model. To tackle the aforementioned challenges, we propose Multimodal Graph Neural Network for Recommendation (MGNM) with Dynamic De-redundancy and Modality-Guided Feature De-noisy, which is divided into local and global interaction. Initially, in the local interaction process,we integrate a dynamic de-redundancy (DDR) loss function which is achieved by utilizing the product of the feature coefficient matrix and the feature matrix as a penalization factor. It reduces the feature redundancy effects of multimodal and behavioral features caused by the stacking of multiple GNN layers. Subsequently, in the global interaction process, we developed modality-guided global feature purifiers for each modality to alleviate the impact of modality noise. It is a two-fold guiding mechanism eliminating modality features that are irrelevant to user preferences and captures complex relationships within the modality. Experimental results demonstrate that MGNM achieves superior performance on multimodal information denoising and removal of redundant information compared to the state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2411.01561

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingGraph Neural NetworkMultimodal Recommendation

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

Improving Multimodal Sentiment Analysis via Modality Optimization and Dynamic Primary Modality Selection

2025-11-09 · Dingkang Yang, Mingcheng Li, Xuecheng Wu, Zhaoyu Chen 외 arxiv

Multimodal Sentiment Analysis (MSA) aims to predict sentiment from language, acoustic, and visual data in videos. However, imbalanced unimodal performance often leads to suboptimal fused representations. Existing approac…

Multimodal Sentiment Analysis

EGRA:Toward Enhanced Behavior Graphs and Representation Alignment for Multimodal Recommendation

2025-08-22 · Xiaoxiong Zhang, Xin Zhou, Zhiwei Zeng, Yongjie Wang 외 arxiv

MultiModal Recommendation (MMR) systems have emerged as a promising solution for improving recommendation quality by leveraging rich item-side modality information, prompting a surge of diverse methods. Despite these adv…

Multimodal Recommendation

Knowledge Soft Integration for Multimodal Recommendation

2023-05-12 · Kai Ouyang, Chen Tang, Wenhao Zheng, Xiangjin Xie 외

One of the main challenges in modern recommendation systems is how to effectively utilize multimodal content to achieve more personalized recommendations. Despite various proposed solutions, most of them overlook the mis…

Graph Neural NetworkMultimodal RecommendationRecommendation SystemsRetrieval

MENTOR: Multi-level Self-supervised Learning for Multimodal Recommendation

2024-02-29 · Jinfeng Xu, Zheyu Chen, Shuo Yang, Jinze Li 외

With the increasing multimedia information, multimodal recommendation has received extensive attention. It utilizes multimodal information to alleviate the data sparsity problem in recommendation systems, thus improving …

cross-modal alignmentMultimodal RecommendationRecommendation SystemsSelf-Supervised Learning

MM-DFN: Multimodal Dynamic Fusion Network for Emotion Recognition in Conversations

2022-03-04 · Dou Hu, Xiaolong Hou, Lingwei Wei, Lianxin Jiang 외

Emotion Recognition in Conversations (ERC) has considerable prospects for developing empathetic machines. For multimodal ERC, it is vital to understand context and fuse modality information in conversations. Recent graph…

Emotion RecognitionEmotion Recognition in Conversation