Formalizing Multimedia Recommendation through Multimodal Deep Learning
Recommender systems (RSs) offer personalized navigation experiences on online platforms, but recommendation remains a challenging task, particularly in specific scenarios and domains. Multimodality can help tap into richer information sources and construct more refined user/item profiles for recommendations. However, existing literature lacks a shared and universal schema for modeling and solving the recommendation problem through the lens of multimodality. This work aims to formalize a general multimodal schema for multimedia recommendation. It provides a comprehensive literature review of multimodal approaches for multimedia recommendation from the last eight years, outlines the theoretical foundations of a multimodal pipeline, and demonstrates its rationale by applying it to selected state-of-the-art approaches. The work also conducts a benchmarking analysis of recent algorithms for multimedia recommendation within Elliot, a rigorous framework for evaluating recommender systems. The main aim is to provide guidelines for designing and implementing the next generation of multimodal approaches in multimedia recommendation.
Code (1)
Tasks
BenchmarkingDeep LearningMultimedia recommendationMultimodal Deep LearningRecommendation SystemsSimilar Papers 제목 키워드 기반
Mining Latent Structures for Multimedia Recommendation
Multimedia content is of predominance in the modern Web era. Investigating how users interact with multimodal items is a continuing concern within the rapid development of recommender systems. The majority of previous wo…
Collaborative FilteringMultimedia recommendationMulti-modal RecommendationMultimodal Recommendation+1Formalizing Integration Patterns with Multimedia Data (Extended Version)
The previous works on formalizing enterprise application integration (EAI) scenarios showed an emerging need for setting up formal foundations for integration patterns, the EAI building blocks, in order to facilitate the…
Latent Structure Mining with Contrastive Modality Fusion for Multimedia Recommendation
Recent years have witnessed growing interests in multimedia recommendation, which aims to predict whether a user will interact with an item with multimodal contents. Previous studies focus on modeling user-item interacti…
Collaborative FilteringMultimedia recommendationMultimodality Invariant Learning for Multimedia-Based New Item Recommendation
Multimedia-based recommendation provides personalized item suggestions by learning the content preferences of users. With the proliferation of digital devices and APPs, a huge number of new items are created rapidly over…
Dynamic Fusion Strategies for Federated Multimodal Recommendations
Delivering deeply personalized recommendations necessitates understanding user interactions with diverse multimedia features, but achieving this within the constraints of Federated Recommendation Systems (FedRec) is seve…
Multimodal RecommendationPrivacy PreservingRecommendation Systems