Multi-Modal Recommendation System with Auxiliary Information
Context-aware recommendation systems improve upon classical recommender systems by including, in the modelling, a user's behaviour. Research into context-aware recommendation systems has previously only considered the sequential ordering of items as contextual information. However, there is a wealth of unexploited additional multi-modal information available in auxiliary knowledge related to items. This study extends the existing research by evaluating a multi-modal recommendation system that exploits the inclusion of comprehensive auxiliary knowledge related to an item. The empirical results explore extracting vector representations (embeddings) from unstructured and structured data using data2vec. The fused embeddings are then used to train several state-of-the-art transformer architectures for sequential user-item representations. The analysis of the experimental results shows a statistically significant improvement in prediction accuracy, which confirms the effectiveness of including auxiliary information in a context-aware recommendation system. We report a 4% and 11% increase in the NDCG score for long and short user sequence datasets, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-modal RecommendationRecommendation SystemsSimilar Papers 제목 키워드 기반
A multimedia recommendation model based on collaborative graph
As one of the main solutions to the information overload problem, recommender systems are widely used in daily life. In the recent emerging micro-video recommendation scenario, micro-videos contain rich multimedia inform…
Graph Neural NetworkmodelMultimedia recommendationRecommendation SystemsAlignRec: Aligning and Training in Multimodal Recommendations
With the development of multimedia systems, multimodal recommendations are playing an essential role, as they can leverage rich contexts beyond interactions. Existing methods mainly regard multimodal information as an au…
Multimodal RecommendationTowards Bridging the Cross-modal Semantic Gap for Multi-modal Recommendation
Multi-modal recommendation greatly enhances the performance of recommender systems by modeling the auxiliary information from multi-modality contents. Most existing multi-modal recommendation models primarily exploit mul…
cross-modal alignmentMulti-modal RecommendationRecommendation SystemsSemantic Similarity+1Bootstrap Latent Representations for Multi-modal Recommendation
This paper studies the multi-modal recommendation problem, where the item multi-modality information (e.g., images and textual descriptions) is exploited to improve the recommendation accuracy. Besides the user-item inte…
Multi-modal RecommendationSynerGraph: An Integrated Graph Convolution Network for Multimodal Recommendation
This article presents a novel approach to multimodal recommendation systems, focusing on integrating and purifying multimodal data. Our methodology starts by developing a filter to remove noise from various types of data…
Multimodal RecommendationRecommendation Systems