paper-with-me

홈 › Papers

Position-aware Graph Transformer for Recommendation

2024-12-25 · Jiajia Chen, Jiancan Wu, Jiawei Chen, Chongming Gao, Yong Li, Xiang Wang

Collaborative recommendation fundamentally involves learning high-quality user and item representations from interaction data. Recently, graph convolution networks (GCNs) have advanced the field by utilizing high-order connectivity patterns in interaction graphs, as evidenced by state-of-the-art methods like PinSage and LightGCN. However, one key limitation has not been well addressed in existing solutions: capturing long-range collaborative filtering signals, which are crucial for modeling user preference. In this work, we propose a new graph transformer (GT) framework -- \textit{Position-aware Graph Transformer for Recommendation} (PGTR), which combines the global modeling capability of Transformer blocks with the local neighborhood feature extraction of GCNs. The key insight is to explicitly incorporate node position and structure information from the user-item interaction graph into GT architecture via several purpose-designed positional encodings. The long-range collaborative signals from the Transformer block are then combined linearly with the local neighborhood features from the GCN backbone to enhance node embeddings for final recommendations. Empirical studies demonstrate the effectiveness of the proposed PGTR method when implemented on various GCN-based backbones across four real-world datasets, and the robustness against interaction sparsity as well as noise.

📄 PDF Abstract BibTeX arXiv:2412.18731

Code (0)

등록된 구현이 없습니다.

Tasks

Collaborative FilteringPosition

Methods 이 논문이 사용한 방법론

LapEigen 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

SIGformer: Sign-aware Graph Transformer for Recommendation

2024-04-18 · Sirui Chen, Jiawei Chen, Sheng Zhou, Bohao Wang 외

In recommender systems, most graph-based methods focus on positive user feedback, while overlooking the valuable negative feedback. Integrating both positive and negative feedback to form a signed graph can lead to a mor…

Recommendation Systems

Trie-Aware Transformers for Generative Recommendation

2026-02-25 · Zhenxiang Xu, Jiawei Chen, Sirui Chen, Yong He 외 arxiv

Generative recommendation (GR) aligns with advances in generative AI by casting next-item prediction as token-level generation rather than score-based ranking. Most GR methods adopt a two-stage pipeline: (i) \textit{item…

Masked Graph Transformer for Large-Scale Recommendation

2024-05-07 · Huiyuan Chen, Zhe Xu, Chin-Chia Michael Yeh, Vivian Lai 외

Graph Transformers have garnered significant attention for learning graph-structured data, thanks to their superb ability to capture long-range dependencies among nodes. However, the quadratic space and time complexity h…

Position-enhanced and Time-aware Graph Convolutional Network for Sequential Recommendations

2021-07-12 · Liwei Huang, Yutao Ma, Yanbo Liu, Bohong 외

Most of the existing deep learning-based sequential recommendation approaches utilize the recurrent neural network architecture or self-attention to model the sequential patterns and temporal influence among a user's his…

PositionSequential Recommendation

Knowledge Enhanced Multi-intent Transformer Network for Recommendation

2024-05-31 · Ding Zou, Wei Wei, Feida Zhu, Chuanyu Xu 외

Incorporating Knowledge Graphs into Recommendation has attracted growing attention in industry, due to the great potential of KG in providing abundant supplementary information and interpretability for the underlying mod…

DenoisingKnowledge GraphsRepresentation Learning