paper-with-me

Papers

Formalizing Multimedia Recommendation through Multimodal Deep Learning

2023-09-11 · Daniele Malitesta, Giandomenico Cornacchia, Claudio Pomo, Felice Antonio Merra, Tommaso Di Noia, Eugenio Di Sciascio

Recommender systems (RSs) offer personalized navigation experiences on online platforms, but recommendation remains a challenging task, particularly in specific scenarios and domains. Multimodality can help tap into richer information sources and construct more refined user/item profiles for recommendations. However, existing literature lacks a shared and universal schema for modeling and solving the recommendation problem through the lens of multimodality. This work aims to formalize a general multimodal schema for multimedia recommendation. It provides a comprehensive literature review of multimodal approaches for multimedia recommendation from the last eight years, outlines the theoretical foundations of a multimodal pipeline, and demonstrates its rationale by applying it to selected state-of-the-art approaches. The work also conducts a benchmarking analysis of recent algorithms for multimedia recommendation within Elliot, a rigorous framework for evaluating recommender systems. The main aim is to provide guidelines for designing and implementing the next generation of multimodal approaches in multimedia recommendation.

📄 PDF Abstract BibTeX arXiv:2309.05273

Code (1)

sisinflab/formal-multimod-rec 공식 구현 tf

Tasks

BenchmarkingDeep LearningMultimedia recommendationMultimodal Deep LearningRecommendation Systems

Similar Papers 제목 키워드 기반

Mining Latent Structures for Multimedia Recommendation

2021-04-19 · Jinghao Zhang, Yanqiao Zhu, Qiang Liu, Shu Wu 외

Multimedia content is of predominance in the modern Web era. Investigating how users interact with multimodal items is a continuing concern within the rapid development of recommender systems. The majority of previous wo…

Collaborative FilteringMultimedia recommendationMulti-modal RecommendationMultimodal Recommendation+1

Formalizing Integration Patterns with Multimedia Data (Extended Version)

2020-09-09 · Marco Montali, Andrey Rivkin, Daniel Ritter

The previous works on formalizing enterprise application integration (EAI) scenarios showed an emerging need for setting up formal foundations for integration patterns, the EAI building blocks, in order to facilitate the…

Latent Structure Mining with Contrastive Modality Fusion for Multimedia Recommendation

2021-11-01 · Jinghao Zhang, Yanqiao Zhu, Qiang Liu, Mengqi Zhang 외

Recent years have witnessed growing interests in multimedia recommendation, which aims to predict whether a user will interact with an item with multimodal contents. Previous studies focus on modeling user-item interacti…

Collaborative FilteringMultimedia recommendation

Multimodality Invariant Learning for Multimedia-Based New Item Recommendation

2024-04-28 · Haoyue Bai, Le Wu, Min Hou, Miaomiao Cai 외

Multimedia-based recommendation provides personalized item suggestions by learning the content preferences of users. With the proliferation of digital devices and APPs, a huge number of new items are created rapidly over…

Dynamic Fusion Strategies for Federated Multimodal Recommendations

2024-10-11 · Zhiwei Li, Guodong Long, Jing Jiang, Chengqi Zhang

Delivering deeply personalized recommendations necessitates understanding user interactions with diverse multimedia features, but achieving this within the constraints of Federated Recommendation Systems (FedRec) is seve…

Multimodal RecommendationPrivacy PreservingRecommendation Systems