paper-with-me

홈 › Papers

Do We Really Need to Drop Items with Missing Modalities in Multimodal Recommendation?

2024-08-21 · Daniele Malitesta, Emanuele Rossi, Claudio Pomo, Tommaso Di Noia, Fragkiskos D. Malliaros

Generally, items with missing modalities are dropped in multimodal recommendation. However, with this work, we question this procedure, highlighting that it would further damage the pipeline of any multimodal recommender system. First, we show that the lack of (some) modalities is, in fact, a widely-diffused phenomenon in multimodal recommendation. Second, we propose a pipeline that imputes missing multimodal features in recommendation by leveraging traditional imputation strategies in machine learning. Then, given the graph structure of the recommendation data, we also propose three more effective imputation solutions that leverage the item-item co-purchase graph and the multimodal similarities of co-interacted items. Our method can be plugged into any multimodal RSs in the literature working as an untrained pre-processing phase, showing (through extensive experiments) that any data pre-filtering is not only unnecessary but also harmful to the performance.

📄 PDF Abstract BibTeX arXiv:2408.11767

Code (1)

sisinflab/graph-missing-modalities 공식 구현 pytorch

Tasks

ImputationMultimodal RecommendationRecommendation Systems

Similar Papers 제목 키워드 기반

LRMM: Learning to Recommend with Missing Modalities

2018-08-21 · EMNLP 2018 10 · Cheng Wang, Mathias Niepert, Hui Li

Multimodal learning has shown promising performance in content-based recommendation due to the auxiliary user and item information of multiple modalities such as text and images. However, the problem of incomplete and mi…

Recommendation Systems

A unified representation network for segmentation with missing modalities

2019-08-19 · Kenneth Lau, Jonas Adler, Jens Sjölund

Over the last few years machine learning has demonstrated groundbreaking results in many areas of medical image analysis, including segmentation. A key assumption, however, is that the train- and test distributions match…

Medical Image AnalysisSegmentation

Knowledge Distillation for Multimodal Egocentric Action Recognition Robust to Missing Modalities

2025-04-11 · Maria Santos-Villafranca, Dustin Carrión-Ojeda, Alejandro Perez-Yus, Jesus Bermudez-Cameo 외

Action recognition is an essential task in egocentric vision due to its wide range of applications across many fields. While deep learning methods have been proposed to address this task, most rely on a single modality, …

Action RecognitionKnowledge Distillation

Toward Reliable RGB-D Semantic Segmentation: Handling Missing Modalities via Condition Dropout

2026-07-22 · Xuchen Zhu, Yajuan Wei, Shuang Hao, Jiwei Jiang 외 arxiv

RGB-D semantic segmentation has achieved remarkable progress, yet most models assume that RGB and depth are always available. In practice, failures or occlusions of surveillance sensors often remove one modality. Althoug…

Semantic Segmentation

ModDrop++: A Dynamic Filter Network with Intra-subject Co-training for Multiple Sclerosis Lesion Segmentation with Missing Modalities

2022-03-07 · Han Liu, Yubo Fan, Hao Li, Jiacheng Wang 외

Multiple Sclerosis (MS) is a chronic neuroinflammatory disease and multi-modality MRIs are routinely used to monitor MS lesions. Many automatic MS lesion segmentation models have been developed and have reached human-lev…

Lesion Segmentation