paper-with-me

홈 › Papers

Lightweight yet Efficient: An External Attentive Graph Convolutional Network with Positional Prompts for Sequential Recommendation

2025-02-21 · Jinyu Zhang, Chao Li, Zhongying Zhao

Graph-based Sequential Recommender systems (GSRs) have gained significant research attention due to their ability to simultaneously handle user-item interactions and sequential relationships between items. Current GSRs often utilize composite or in-depth structures for graph encoding (e.g., the Graph Transformer). Nevertheless, they have high computational complexity, hindering the deployment on resource-constrained edge devices. Moreover, the relative position encoding in Graph Transformer has difficulty in considering the complicated positional dependencies within sequence. To this end, we propose an External Attentive Graph convolutional network with Positional prompts for Sequential recommendation, namely EA-GPS. Specifically, we first introduce an external attentive graph convolutional network that linearly measures the global associations among nodes via two external memory units. Then, we present a positional prompt-based decoder that explicitly treats the absolute item positions as external prompts. By introducing length-adaptive sequential masking and a soft attention network, such a decoder facilitates the model to capture the long-term positional dependencies and contextual relationships within sequences. Extensive experimental results on five real-world datasets demonstrate that the proposed EA-GPS outperforms the state-of-the-art methods. Remarkably, it achieves the superior performance while maintaining a smaller parameter size and lower training overhead. The implementation of this work is publicly available at https://github.com/ZZY-GraphMiningLab/EA-GPS.

📄 PDF Abstract BibTeX arXiv:2502.15331

Code (1)

JinyuZ1996/EA-GPS 공식 구현 tf

Tasks

DecoderRecommendation SystemsSequential Recommendation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
LapEigen 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Lightweight yet Fine-grained: A Graph Capsule Convolutional Network with Subspace Alignment for Shared-account Sequential Recommendation

2024-12-18 · Jinyu Zhang, Zhongying Zhao, Chao Li, Yanwei Yu

Shared-account Sequential Recommendation (SSR) aims to provide personalized recommendations for accounts shared by multiple users with varying sequential preferences. Previous studies on SSR struggle to capture the fine-…

Sequential Recommendation

GIN-SD: Source Detection in Graphs with Incomplete Nodes via Positional Encoding and Attentive Fusion

2024-02-27 · Le Cheng, Peican Zhu, Keke Tang, Chao GAO 외

Source detection in graphs has demonstrated robust efficacy in the domain of rumor source identification. Although recent solutions have enhanced performance by leveraging deep neural networks, they often require complet…

Contextualized Knowledge-aware Attentive Neural Network: Enhancing Answer Selection with Knowledge

2021-04-12 · Yang Deng, Yuexiang Xie, Yaliang Li, Min Yang 외

Answer selection, which is involved in many natural language processing applications such as dialog systems and question answering (QA), is an important yet challenging task in practice, since conventional methods typica…

Answer SelectionQuestion AnsweringRepresentation LearningSentence

Constituency Parsing with a Self-Attentive Encoder

2018-05-02 · ACL 2018 7 · Nikita Kitaev, Dan Klein

We demonstrate that replacing an LSTM encoder with a self-attentive architecture can lead to improvements to a state-of-the-art discriminative constituency parser. The use of attention makes explicit the manner in which …

Constituency ParsingSentence

Attentive Convolution: Equipping CNNs with RNN-style Attention Mechanisms

2017-10-02 · TACL 2018 1 · Wenpeng Yin, Hinrich Schütze

In NLP, convolutional neural networks (CNNs) have benefited less than recurrent neural networks (RNNs) from attention mechanisms. We hypothesize that this is because the attention in CNNs has been mainly implemented as a…

Claim VerificationNatural Language InferenceRepresentation LearningSentence+1