paper-with-me

Papers

Multi-View Graph Convolutional Network for Multimedia Recommendation

2023-08-07 · Penghang Yu, Zhiyi Tan, Guanming Lu, Bing-Kun Bao

Multimedia recommendation has received much attention in recent years. It models user preferences based on both behavior information and item multimodal information. Though current GCN-based methods achieve notable success, they suffer from two limitations: (1) Modality noise contamination to the item representations. Existing methods often mix modality features and behavior features in a single view (e.g., user-item view) for propagation, the noise in the modality features may be amplified and coupled with behavior features. In the end, it leads to poor feature discriminability; (2) Incomplete user preference modeling caused by equal treatment of modality features. Users often exhibit distinct modality preferences when purchasing different items. Equally fusing each modality feature ignores the relative importance among different modalities, leading to the suboptimal user preference modeling. To tackle the above issues, we propose a novel Multi-View Graph Convolutional Network for the multimedia recommendation. Specifically, to avoid modality noise contamination, the modality features are first purified with the aid of item behavior information. Then, the purified modality features of items and behavior features are enriched in separate views, including the user-item view and the item-item view. In this way, the distinguishability of features is enhanced. Meanwhile, a behavior-aware fuser is designed to comprehensively model user preferences by adaptively learning the relative importance of different modality features. Furthermore, we equip the fuser with a self-supervised auxiliary task. This task is expected to maximize the mutual information between the fused multimodal features and behavior features, so as to capture complementary and supplementary preference information simultaneously. Extensive experiments on three public datasets demonstrate the effectiveness of our methods.

📄 PDF Abstract BibTeX arXiv:2308.03588

Code (1)

demonph10/mgcn 공식 구현 pytorch

Tasks

Multimedia recommendation

Similar Papers 제목 키워드 기반

Less is More: Information Bottleneck Denoised Multimedia Recommendation

2025-01-21 · Yonghui Yang, Le Wu, Zhuangzhuang He, Zhengwei Wu 외

Empowered by semantic-rich content information, multimedia recommendation has emerged as a potent personalized technique. Current endeavors center around harnessing multimedia content to refine item representation or unc…

Multimedia recommendation

Formalizing Multimedia Recommendation through Multimodal Deep Learning

2023-09-11 · Daniele Malitesta, Giandomenico Cornacchia, Claudio Pomo, Felice Antonio Merra 외

Recommender systems (RSs) offer personalized navigation experiences on online platforms, but recommendation remains a challenging task, particularly in specific scenarios and domains. Multimodality can help tap into rich…

BenchmarkingDeep LearningMultimedia recommendationMultimodal Deep Learning+1

GRCN: Graph-Refined Convolutional Network for Multimedia Recommendation with Implicit Feedback

2021-11-03 · Wei Yinwei, Wang Xiang, Nie Liqiang, He Xiangnan 외

Reorganizing implicit feedback of users as a user-item interaction graph facilitates the applications of graph convolutional networks (GCNs) in recommendation tasks. In the interaction graph, edges between user and item …

Multimedia recommendationMulti-modal Recommendation

Mining Latent Structures for Multimedia Recommendation

2021-04-19 · Jinghao Zhang, Yanqiao Zhu, Qiang Liu, Shu Wu 외

Multimedia content is of predominance in the modern Web era. Investigating how users interact with multimodal items is a continuing concern within the rapid development of recommender systems. The majority of previous wo…

Collaborative FilteringMultimedia recommendationMulti-modal RecommendationMultimodal Recommendation+1

Self-Supervised Learning for Multimedia Recommendation

2022-06-30 · IEEE Transactions on Multimedia (TMM) 2022 6 · Zhulin Tao, Xiaohao Liu, Yewei Xia, Xiang Wang 외

Learning representations for multimedia content is critical for multimedia recommendation. Current representation learning methods roughly fall into two groups: (1) using the historical interactions to create ID embeddin…

Contrastive LearningData AugmentationMultimedia recommendationMulti-modal Recommendation+2