paper-with-me

Papers

Mining Latent Structures for Multimedia Recommendation

2021-04-19 · Jinghao Zhang, Yanqiao Zhu, Qiang Liu, Shu Wu, Shuhui Wang, Liang Wang

Multimedia content is of predominance in the modern Web era. Investigating how users interact with multimodal items is a continuing concern within the rapid development of recommender systems. The majority of previous work focuses on modeling user-item interactions with multimodal features included as side information. However, this scheme is not well-designed for multimedia recommendation. Specifically, only collaborative item-item relationships are implicitly modeled through high-order item-user-item relations. Considering that items are associated with rich contents in multiple modalities, we argue that the latent semantic item-item structures underlying these multimodal contents could be beneficial for learning better item representations and further boosting recommendation. To this end, we propose a LATent sTructure mining method for multImodal reCommEndation, which we term LATTICE for brevity. To be specific, in the proposed LATTICE model, we devise a novel modality-aware structure learning layer, which learns item-item structures for each modality and aggregates multiple modalities to obtain latent item graphs. Based on the learned latent graphs, we perform graph convolutions to explicitly inject high-order item affinities into item representations. These enriched item representations can then be plugged into existing collaborative filtering methods to make more accurate recommendations. Extensive experiments on three real-world datasets demonstrate the superiority of our method over state-of-the-art multimedia recommendation methods and validate the efficacy of mining latent item-item relationships from multimodal features.

📄 PDF Abstract BibTeX arXiv:2104.09036

Code (1)

CRIPAC-DIG/LATTICE 공식 구현 pytorch

Tasks

Collaborative FilteringMultimedia recommendationMulti-modal RecommendationMultimodal RecommendationRecommendation Systems

Similar Papers 제목 키워드 기반

Latent Structure Mining with Contrastive Modality Fusion for Multimedia Recommendation

2021-11-01 · Jinghao Zhang, Yanqiao Zhu, Qiang Liu, Mengqi Zhang 외

Recent years have witnessed growing interests in multimedia recommendation, which aims to predict whether a user will interact with an item with multimodal contents. Previous studies focus on modeling user-item interacti…

Collaborative FilteringMultimedia recommendation

Less is More: Information Bottleneck Denoised Multimedia Recommendation

2025-01-21 · Yonghui Yang, Le Wu, Zhuangzhuang He, Zhengwei Wu 외

Empowered by semantic-rich content information, multimedia recommendation has emerged as a potent personalized technique. Current endeavors center around harnessing multimedia content to refine item representation or unc…

Multimedia recommendation

Personalized Multimedia Item and Key Frame Recommendation

2019-06-01 · Le Wu, Lei Chen, Yonghui Yang, Richang Hong 외

When recommending or advertising items to users, an emerging trend is to present each multimedia item with a key frame image (e.g., the poster of a movie). As each multimedia item can be represented as multiple fine-grai…

A Multi-Modal Latent-Features based Service Recommendation System for the Social Internet of Things

2023-06-01 · Amar Khelloufi, Huansheng Ning, Abdenacer Naouri, Abdelkarim Ben Sada 외

The Social Internet of Things (SIoT), is revolutionizing how we interact with our everyday lives. By adding the social dimension to connecting devices, the SIoT has the potential to drastically change the way we interact…

Recommendation Systems

Mining Stable Preferences: Adaptive Modality Decorrelation for Multimedia Recommendation

2023-06-25 · Jinghao Zhang, Qiang Liu, Shu Wu, Liang Wang

Multimedia content is of predominance in the modern Web era. In real scenarios, multiple modalities reveal different aspects of item attributes and usually possess different importance to user purchase decisions. However…

Multimedia recommendation