Introducing Self-Attention to Target Attentive Graph Neural Networks
Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate information from neighboring nodes i.e., local message passing. Such graph-based architectures have representational limits, as a single sub-graph is susceptible to overfit the sequential dependencies instead of accounting for complex transitions between items in different sessions. We propose a new technique that leverages a Transformer in combination with a target attentive GNN. This allows richer representations to be learnt, which translates to empirical performance gains in comparison to a vanilla target attentive GNN. Our experimental results and ablation show that our proposed method is competitive with the existing methods on real-world benchmark datasets, improving on graph-based hypotheses. Code is available at https://github.com/The-Learning-Machines/SBR
Code (1)
Tasks
Recommendation SystemsRepresentation LearningSession-Based RecommendationsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improving Graph Representation for Point Cloud Segmentation via Attentive Filtering
Recently, self-attention networks achieve impressive performance in point cloud segmentation due to their superiority in modeling long-range dependencies. However, compared to self-attention mechanism, we find graph …
Point Cloud SegmentationLatent Tree Decomposition Parsers for AMR-to-Text Generation
Graph encoders in AMR-to-text generation models often rely on neighborhood convolutions or global vertex attention. While these approaches apply to general graphs, AMRs may be amenable to encoders that target their tree-…
AMR-to-Text GenerationClusteringMolecular Property PredictionProperty Prediction+2Attentive Graph Neural Networks for Few-Shot Learning
Graph Neural Networks (GNN) has demonstrated the superior performance in many challenging applications, including the few-shot learning tasks. Despite its powerful capacity to learn and generalize the model from few samp…
Few-Shot LearningModeling Sequences as Star Graphs to Address Over-smoothing in Self-attentive Sequential Recommendation
Self-attention (SA) mechanisms have been widely used in developing sequential recommendation (SR) methods, and demonstrated state-of-the-art performance. However, in this paper, we show that self-attentive SR methods sub…
Sequential RecommendationA Structured Self-attentive Sentence Embedding
This paper proposes a new model for extracting an interpretable sentence embedding by introducing self-attention. Instead of using a vector, we use a 2-D matrix to represent the embedding, with each row of the matrix att…
Author ProfilingGeneral ClassificationNatural Language InferenceSentence+4