paper-with-me

홈 › Papers

LRMM: Learning to Recommend with Missing Modalities

2018-08-21 · EMNLP 2018 10 · Cheng Wang, Mathias Niepert, Hui Li

Multimodal learning has shown promising performance in content-based recommendation due to the auxiliary user and item information of multiple modalities such as text and images. However, the problem of incomplete and missing modality is rarely explored and most existing methods fail in learning a recommendation model with missing or corrupted modalities. In this paper, we propose LRMM, a novel framework that mitigates not only the problem of missing modalities but also more generally the cold-start problem of recommender systems. We propose modality dropout (m-drop) and a multimodal sequential autoencoder (m-auto) to learn multimodal representations for complementing and imputing missing modalities. Extensive experiments on real-world Amazon data show that LRMM achieves state-of-the-art performance on rating prediction tasks. More importantly, LRMM is more robust to previous methods in alleviating data-sparsity and the cold-start problem.

📄 PDF Abstract BibTeX arXiv:1808.06791

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation Systems

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Learned Risk Metric Maps for Kinodynamic Systems

2023-02-28 · Ross Allen, Wei Xiao, Daniela Rus

We present Learned Risk Metric Maps (LRMM) for real-time estimation of coherent risk metrics of high dimensional dynamical systems operating in unstructured, partially observed environments. LRMM models are simple to des…

Disentangling and Generating Modalities for Recommendation in Missing Modality Scenarios

2025-04-23 · Jiwan Kim, Hongseok Kang, Sein Kim, Kibum Kim 외

Multi-modal recommender systems (MRSs) have achieved notable success in improving personalization by leveraging diverse modalities such as images, text, and audio. However, two key challenges remain insufficiently addres…

Cross-Modal RetrievalRecommendation Systems

Do We Really Need to Drop Items with Missing Modalities in Multimodal Recommendation?

2024-08-21 · Daniele Malitesta, Emanuele Rossi, Claudio Pomo, Tommaso Di Noia 외

Generally, items with missing modalities are dropped in multimodal recommendation. However, with this work, we question this procedure, highlighting that it would further damage the pipeline of any multimodal recommender…

ImputationMultimodal RecommendationRecommendation Systems

Dealing with Missing Modalities in Multimodal Recommendation: a Feature Propagation-based Approach

2024-03-28 · Daniele Malitesta, Emanuele Rossi, Claudio Pomo, Fragkiskos D. Malliaros 외

Multimodal recommender systems work by augmenting the representation of the products in the catalogue through multimodal features extracted from images, textual descriptions, or audio tracks characterising such products.…

Graph Representation LearningMultimodal RecommendationRecommendation SystemsRepresentation Learning

A Multimodal Single-Branch Embedding Network for Recommendation in Cold-Start and Missing Modality Scenarios

2024-09-26 · Christian Ganhör, Marta Moscati, Anna Hausberger, Shah Nawaz 외

Most recommender systems adopt collaborative filtering (CF) and provide recommendations based on past collective interactions. Therefore, the performance of CF algorithms degrades when few or no interactions are availabl…

Collaborative FilteringMultimodal RecommendationRecommendation Systems