Visually Aware Skip-Gram for Image Based Recommendations
The visual appearance of a product significantly influences purchase decisions on e-commerce websites. We propose a novel framework VASG (Visually Aware Skip-Gram) for learning user and product representations in a common latent space using product image features. Our model is an amalgamation of the Skip-Gram architecture and a deep neural network based Decoder. Here the Skip-Gram attempts to capture user preference by optimizing user-product co-occurrence in a Heterogeneous Information Network while the Decoder simultaneously learns a mapping to transform product image features to the Skip-Gram embedding space. This architecture is jointly optimized in an end-to-end, multitask fashion. The proposed framework enables us to make personalized recommendations for cold-start products which have no purchase history. Experiments conducted on large real-world datasets show that the learned embeddings can generate effective recommendations using nearest neighbour searches.
Code (1)
Tasks
DecoderSimilar Papers 제목 키워드 기반
Enhancing Sequential Music Recommendation with Negative Feedback-informed Contrastive Learning
Modern music streaming services are heavily based on recommendation engines to serve content to users. Sequential recommendation -- continuously providing new items within a single session in a contextually coherent mann…
Contrastive LearningMusic RecommendationSequential RecommendationSession-Based RecommendationsAI Recommendation System for Enhanced Customer Experience: A Novel Image-to-Text Method
Existing fashion recommendation systems encounter difficulties in using visual data for accurate and personalized recommendations. This research describes an innovative end-to-end pipeline that uses artificial intelligen…
Image to textObjectobject-detectionObject Detection+3Combining Language and Vision with a Multimodal Skip-gram Model
We extend the SKIP-GRAM model of Mikolov et al. (2013a) by taking visual information into account. Like SKIP-GRAM, our multimodal models (MMSKIP-GRAM) build vector-based word representations by learning to predict lingui…
RetrievalImproving Character-Aware Neural Language Model by Warming up Character Encoder under Skip-gram Architecture
Character-aware neural language models can capture the relationship between words by exploiting character-level information and are particularly effective for languages with rich morphology. However, these models are usu…
Language ModelingLanguage ModellingCombating the Filter Bubble: Designing for Serendipity in a University Course Recommendation System
Collaborative filtering based algorithms, including Recurrent Neural Networks (RNN), tend towards predicting a perpetuation of past observed behavior. In a recommendation context, this can lead to an overly narrow set of…
Collaborative Filtering