LRMM: Learning to Recommend with Missing Modalities
Multimodal learning has shown promising performance in content-based recommendation due to the auxiliary user and item information of multiple modalities such as text and images. However, the problem of incomplete and missing modality is rarely explored and most existing methods fail in learning a recommendation model with missing or corrupted modalities. In this paper, we propose LRMM, a novel framework that mitigates not only the problem of missing modalities but also more generally the cold-start problem of recommender systems. We propose modality dropout (m-drop) and a multimodal sequential autoencoder (m-auto) to learn multimodal representations for complementing and imputing missing modalities. Extensive experiments on real-world Amazon data show that LRMM achieves state-of-the-art performance on rating prediction tasks. More importantly, LRMM is more robust to previous methods in alleviating data-sparsity and the cold-start problem.
Code (0)
등록된 구현이 없습니다.
Tasks
Recommendation SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learned Risk Metric Maps for Kinodynamic Systems
We present Learned Risk Metric Maps (LRMM) for real-time estimation of coherent risk metrics of high dimensional dynamical systems operating in unstructured, partially observed environments. LRMM models are simple to des…
Disentangling and Generating Modalities for Recommendation in Missing Modality Scenarios
Multi-modal recommender systems (MRSs) have achieved notable success in improving personalization by leveraging diverse modalities such as images, text, and audio. However, two key challenges remain insufficiently addres…
Cross-Modal RetrievalRecommendation SystemsDo We Really Need to Drop Items with Missing Modalities in Multimodal Recommendation?
Generally, items with missing modalities are dropped in multimodal recommendation. However, with this work, we question this procedure, highlighting that it would further damage the pipeline of any multimodal recommender…
ImputationMultimodal RecommendationRecommendation SystemsDealing with Missing Modalities in Multimodal Recommendation: a Feature Propagation-based Approach
Multimodal recommender systems work by augmenting the representation of the products in the catalogue through multimodal features extracted from images, textual descriptions, or audio tracks characterising such products.…
Graph Representation LearningMultimodal RecommendationRecommendation SystemsRepresentation LearningA Multimodal Single-Branch Embedding Network for Recommendation in Cold-Start and Missing Modality Scenarios
Most recommender systems adopt collaborative filtering (CF) and provide recommendations based on past collective interactions. Therefore, the performance of CF algorithms degrades when few or no interactions are availabl…
Collaborative FilteringMultimodal RecommendationRecommendation Systems