paper-with-me

홈 › Papers

Bootstrap Latent Representations for Multi-modal Recommendation

2022-07-13 · Xin Zhou, HongYu Zhou, Yong liu, Zhiwei Zeng, Chunyan Miao, Pengwei Wang, Yuan You, Feijun Jiang

This paper studies the multi-modal recommendation problem, where the item multi-modality information (e.g., images and textual descriptions) is exploited to improve the recommendation accuracy. Besides the user-item interaction graph, existing state-of-the-art methods usually use auxiliary graphs (e.g., user-user or item-item relation graph) to augment the learned representations of users and/or items. These representations are often propagated and aggregated on auxiliary graphs using graph convolutional networks, which can be prohibitively expensive in computation and memory, especially for large graphs. Moreover, existing multi-modal recommendation methods usually leverage randomly sampled negative examples in Bayesian Personalized Ranking (BPR) loss to guide the learning of user/item representations, which increases the computational cost on large graphs and may also bring noisy supervision signals into the training process. To tackle the above issues, we propose a novel self-supervised multi-modal recommendation model, dubbed BM3, which requires neither augmentations from auxiliary graphs nor negative samples. Specifically, BM3 first bootstraps latent contrastive views from the representations of users and items with a simple dropout augmentation. It then jointly optimizes three multi-modal objectives to learn the representations of users and items by reconstructing the user-item interaction graph and aligning modality features under both inter- and intra-modality perspectives. BM3 alleviates both the need for contrasting with negative examples and the complex graph augmentation from an additional target network for contrastive view generation. We show BM3 outperforms prior recommendation models on three datasets with number of nodes ranging from 20K to 200K, while achieving a 2-9X reduction in training time. Our code is available at https://github.com/enoche/BM3.

📄 PDF Abstract BibTeX arXiv:2207.05969

Code (2)

enoche/bm3 공식 구현 pytorch
enoche/mmrec pytorch

Tasks

Multi-modal Recommendation

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Mining Latent Structures for Multimedia Recommendation

2021-04-19 · Jinghao Zhang, Yanqiao Zhu, Qiang Liu, Shu Wu 외

Multimedia content is of predominance in the modern Web era. Investigating how users interact with multimodal items is a continuing concern within the rapid development of recommender systems. The majority of previous wo…

Collaborative FilteringMultimedia recommendationMulti-modal RecommendationMultimodal Recommendation+1

Bootstrap Latent-Predictive Representations for Multitask Reinforcement Learning

2020-04-30 · ICML 2020 1 · Daniel Guo, Bernardo Avila Pires, Bilal Piot, Jean-bastien Grill 외

Learning a good representation is an essential component for deep reinforcement learning (RL). Representation learning is especially important in multitask and partially observable settings where building a representatio…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

Latent Structure Mining with Contrastive Modality Fusion for Multimedia Recommendation

2021-11-01 · Jinghao Zhang, Yanqiao Zhu, Qiang Liu, Mengqi Zhang 외

Recent years have witnessed growing interests in multimedia recommendation, which aims to predict whether a user will interact with an item with multimodal contents. Previous studies focus on modeling user-item interacti…

Collaborative FilteringMultimedia recommendation

Latent-Aligned Reasoning for Multimodal Recommendation

2026-09-04 · Jiarui Jin, Anyang Ji arxiv

Multimodal Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding, yet a fundamental challenge persists when applying them to recommendation: as representations propagate thr…

Multimodal RecommendationContrastive Learning

A Multi-Modal Latent-Features based Service Recommendation System for the Social Internet of Things

2023-06-01 · Amar Khelloufi, Huansheng Ning, Abdenacer Naouri, Abdelkarim Ben Sada 외

The Social Internet of Things (SIoT), is revolutionizing how we interact with our everyday lives. By adding the social dimension to connecting devices, the SIoT has the potential to drastically change the way we interact…

Recommendation Systems