paper-with-me

Papers

Sequential Recommendation via Adaptive Robust Attention with Multi-dimensional Embeddings

2024-09-08 · Linsey Pang, Amir Hossein Raffiee, Wei Liu, Keld Lundgaard

Sequential recommendation models have achieved state-of-the-art performance using self-attention mechanism. It has since been found that moving beyond only using item ID and positional embeddings leads to a significant accuracy boost when predicting the next item. In recent literature, it was reported that a multi-dimensional kernel embedding with temporal contextual kernels to capture users' diverse behavioral patterns results in a substantial performance improvement. In this study, we further improve the sequential recommender model's robustness and generalization by introducing a mix-attention mechanism with a layer-wise noise injection (LNI) regularization. We refer to our proposed model as adaptive robust sequential recommendation framework (ADRRec), and demonstrate through extensive experiments that our model outperforms existing self-attention architectures.

📄 PDF Abstract BibTeX arXiv:2409.05022

Code (0)

등록된 구현이 없습니다.

Tasks

Sequential Recommendation

Similar Papers 제목 키워드 기반

Context-Adaptive Graph Neural Networks for Next POI Recommendation

2025-06-12 · Yu Lei, Limin Shen, Zhu Sun, Tiantian He 외

Next Point-of-Interest (POI) recommendation is a critical task in location-based services, aiming to predict users' next visits based on their check-in histories. While many existing methods leverage Graph Neural Network…

TokenFormer: Unify the Multi-Field and Sequential Recommendation Worlds

2026-04-15 · Yifeng Zhou, Yuehong Hu, Zhixiang Feng, Junwei Pan 외 arxiv

Recommender systems have historically developed along two largely independent paradigms: feature interaction models for modeling correlations among multi-field categorical features, and sequential models for capturing us…

Sequential Recommendation

A Novel Mamba-based Sequential Recommendation Method

2025-04-10 · Jun Yuan

Sequential recommendation (SR), which encodes user activity to predict the next action, has emerged as a widely adopted strategy in developing commercial personalized recommendation systems. Although Transformer-based mo…

MambaRecommendation SystemsSequential Recommendation

A Framework for Elastic Adaptation of User Multiple Intents in Sequential Recommendation

2025-04-30 · Zhikai Wang, Yanyan Shen

Recently, substantial research has been conducted on sequential recommendation, with the objective of forecasting the subsequent item by leveraging a user's historical sequence of interacted items. Prior studies employ b…

Incremental LearningSequential Recommendation

AdaMCT: Adaptive Mixture of CNN-Transformer for Sequential Recommendation

2022-05-18 · Juyong Jiang, Peiyan Zhang, Yingtao Luo, Chaozhuo Li 외

Sequential recommendation (SR) aims to model users dynamic preferences from a series of interactions. A pivotal challenge in user modeling for SR lies in the inherent variability of user preferences. An effective SR mode…

Inductive BiasSequential Recommendation