Sequential Recommendation via Adaptive Robust Attention with Multi-dimensional Embeddings
Sequential recommendation models have achieved state-of-the-art performance using self-attention mechanism. It has since been found that moving beyond only using item ID and positional embeddings leads to a significant accuracy boost when predicting the next item. In recent literature, it was reported that a multi-dimensional kernel embedding with temporal contextual kernels to capture users' diverse behavioral patterns results in a substantial performance improvement. In this study, we further improve the sequential recommender model's robustness and generalization by introducing a mix-attention mechanism with a layer-wise noise injection (LNI) regularization. We refer to our proposed model as adaptive robust sequential recommendation framework (ADRRec), and demonstrate through extensive experiments that our model outperforms existing self-attention architectures.
Code (0)
등록된 구현이 없습니다.
Tasks
Sequential RecommendationSimilar Papers 제목 키워드 기반
Context-Adaptive Graph Neural Networks for Next POI Recommendation
Next Point-of-Interest (POI) recommendation is a critical task in location-based services, aiming to predict users' next visits based on their check-in histories. While many existing methods leverage Graph Neural Network…
TokenFormer: Unify the Multi-Field and Sequential Recommendation Worlds
Recommender systems have historically developed along two largely independent paradigms: feature interaction models for modeling correlations among multi-field categorical features, and sequential models for capturing us…
Sequential RecommendationA Novel Mamba-based Sequential Recommendation Method
Sequential recommendation (SR), which encodes user activity to predict the next action, has emerged as a widely adopted strategy in developing commercial personalized recommendation systems. Although Transformer-based mo…
MambaRecommendation SystemsSequential RecommendationA Framework for Elastic Adaptation of User Multiple Intents in Sequential Recommendation
Recently, substantial research has been conducted on sequential recommendation, with the objective of forecasting the subsequent item by leveraging a user's historical sequence of interacted items. Prior studies employ b…
Incremental LearningSequential RecommendationAdaMCT: Adaptive Mixture of CNN-Transformer for Sequential Recommendation
Sequential recommendation (SR) aims to model users dynamic preferences from a series of interactions. A pivotal challenge in user modeling for SR lies in the inherent variability of user preferences. An effective SR mode…
Inductive BiasSequential Recommendation