A Hierarchical Self-attentive Convolution Network for Review Modeling in Recommendation Systems
Using reviews to learn user and item representations is important for recommender system. Current review based methods can be divided into two categories: (1) the Convolution Neural Network (CNN) based models that extract n-gram features from user/item reviews; (2) the Recurrent Neural Network (RNN) based models that learn global contextual representations from reviews for users and items. Despite their success, both CNN and RNN based models in previous studies suffer from their own drawbacks. While CNN based models are weak in modeling long-dependency relation in text, RNN based models are slow in training and inference due to their incapability with parallel computing. To alleviate these problems, we propose a new text encoder module for review modeling in recommendation by combining convolution networks with self-attention networks to model local and global interactions in text together.As different words, sentences, reviews have different importance for modeling user and item representations, we construct review models hierarchically in sentence-level, review-level, and user/item level by encoding words for sentences, encoding sentences for reviews, and encoding reviews for user and item representations. Experiments on Amazon Product Benchmark show that our model can achieve significant better performance comparing to the state-of-the-art review based recommendation models.
Code (0)
등록된 구현이 없습니다.
Tasks
Recommendation SystemsSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multiscale Self Attentive Convolutions for Vision and Language Modeling
Self attention mechanisms have become a key building block in many state-of-the-art language understanding models. In this paper, we show that the self attention operator can be formulated in terms of 1x1 convolution ope…
Language ModelingLanguage ModellingOpen-Ended Long-Form Video Question Answering via Hierarchical Convolutional Self-Attention Networks
Open-ended video question answering aims to automatically generate the natural-language answer from referenced video contents according to the given question. Currently, most existing approaches focus on short-form video…
Answer GenerationDecoderFormQuestion Answering+1Attentive Graph-based Text-aware Preference Modeling for Top-N Recommendation
Textual data are commonly used as auxiliary information for modeling user preference nowadays. While many prior works utilize user reviews for rating prediction, few focus on top-N recommendation, and even few try to inc…
A Self-Attentive Hierarchical Model for Jointly Improving Text Summarization and Sentiment Classification
Text summarization and sentiment classification, in NLP, are two main tasks implemented on text analysis, focusing on extracting the major idea of a text at different levels. Based on the characteristics of both, senti…
Abstractive Text SummarizationClassificationGeneral ClassificationSentiment Analysis+2Improving Graph Representation for Point Cloud Segmentation via Attentive Filtering
Recently, self-attention networks achieve impressive performance in point cloud segmentation due to their superiority in modeling long-range dependencies. However, compared to self-attention mechanism, we find graph …
Point Cloud Segmentation