paper-with-me

홈 › Papers

Graph Masked Autoencoder for Sequential Recommendation

2023-05-08 · Yaowen Ye, Lianghao Xia, Chao Huang

While some powerful neural network architectures (e.g., Transformer, Graph Neural Networks) have achieved improved performance in sequential recommendation with high-order item dependency modeling, they may suffer from poor representation capability in label scarcity scenarios. To address the issue of insufficient labels, Contrastive Learning (CL) has attracted much attention in recent methods to perform data augmentation through embedding contrasting for self-supervision. However, due to the hand-crafted property of their contrastive view generation strategies, existing CL-enhanced models i) can hardly yield consistent performance on diverse sequential recommendation tasks; ii) may not be immune to user behavior data noise. In light of this, we propose a simple yet effective Graph Masked AutoEncoder-enhanced sequential Recommender system (MAERec) that adaptively and dynamically distills global item transitional information for self-supervised augmentation. It naturally avoids the above issue of heavy reliance on constructing high-quality embedding contrastive views. Instead, an adaptive data reconstruction paradigm is designed to be integrated with the long-range item dependency modeling, for informative augmentation in sequential recommendation. Extensive experiments demonstrate that our method significantly outperforms state-of-the-art baseline models and can learn more accurate representations against data noise and sparsity. Our implemented model code is available at https://github.com/HKUDS/MAERec.

📄 PDF Abstract BibTeX arXiv:2305.04619

Code (2)

hkuds/gmrec 공식 구현 pytorch
hkuds/maerec 공식 구현 pytorch

Tasks

Contrastive LearningData AugmentationRecommendation SystemsSequential Recommendation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

AutoSeqRec: Autoencoder for Efficient Sequential Recommendation

2023-08-14 · Sijia Liu, Jiahao Liu, Hansu Gu, Dongsheng Li 외

Sequential recommendation demonstrates the capability to recommend items by modeling the sequential behavior of users. Traditional methods typically treat users as sequences of items, overlooking the collaborative relati…

Collaborative FilteringComputational EfficiencySequential Recommendation

Automated Self-Supervised Learning for Recommendation

2023-03-14 · Lianghao Xia, Chao Huang, Chunzhen Huang, Kangyi Lin 외

Graph neural networks (GNNs) have emerged as the state-of-the-art paradigm for collaborative filtering (CF). To improve the representation quality over limited labeled data, contrastive learning has attracted attention i…

Collaborative FilteringContrastive LearningData AugmentationSelf-Supervised Learning

HMAR: Hierarchical Masked Attention for Multi-Behaviour Recommendation

2024-04-29 · Shereen Elsayed, Ahmed Rashed, Lars Schmidt-Thieme

In the context of recommendation systems, addressing multi-behavioral user interactions has become vital for understanding the evolving user behavior. Recent models utilize techniques like graph neural networks and atten…

Multibehavior RecommendationRecommendation Systems

Debiasing the Cloze Task in Sequential Recommendation with Bidirectional Transformers

2023-01-22 · Khalil Damak, Sami Khenissi, Olfa Nasraoui

Bidirectional Transformer architectures are state-of-the-art sequential recommendation models that use a bi-directional representation capacity based on the Cloze task, a.k.a. Masked Language Modeling. The latter aims to…

Language ModelingLanguage ModellingMasked Language ModelingSequential Recommendation

GenRec: Generative Sequential Recommendation with Large Language Models

2024-07-30 · Panfeng Cao, Pietro Lio

Sequential recommendation is a task to capture hidden user preferences from historical user item interaction data and recommend next items for the user. Significant progress has been made in this domain by leveraging cla…

Sequential Recommendation