paper-with-me

Papers

Improving Sequential Recommendations via Bidirectional Temporal Data Augmentation with Pre-training

2021-12-13 · Juyong Jiang, Peiyan Zhang, Yingtao Luo, Chaozhuo Li, Jae Boum Kim, Kai Zhang, Senzhang Wang, Sunghun Kim, Philip S. Yu

Sequential recommendation systems are integral to discerning temporal user preferences. Yet, the task of learning from abbreviated user interaction sequences poses a notable challenge. Data augmentation has been identified as a potent strategy to enhance the informational richness of these sequences. Traditional augmentation techniques, such as item randomization, may disrupt the inherent temporal dynamics. Although recent advancements in reverse chronological pseudo-item generation have shown promise, they can introduce temporal discrepancies when assessed in a natural chronological context. In response, we introduce a sophisticated approach, Bidirectional temporal data Augmentation with pre-training (BARec). Our approach leverages bidirectional temporal augmentation and knowledge-enhanced fine-tuning to synthesize authentic pseudo-prior items that retain user preferences and capture deeper item semantic correlations, thus boosting the model's expressive power. Our comprehensive experimental analysis on five benchmark datasets confirms the superiority of BARec across both short and elongated sequence contexts. Moreover, theoretical examination and case study offer further insight into the model's logical processes and interpretability. The source code for our study is publicly available at https://github.com/juyongjiang/BARec.

📄 PDF Abstract BibTeX arXiv:2112.06460

Code (1)

juyongjiang/barec 공식 구현 tf

Tasks

Data AugmentationKnowledge DistillationRecommendation SystemsSelf-Knowledge DistillationSequential Recommendation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer

2019-04-14 · Fei Sun, Jun Liu, Jian Wu, Changhua Pei 외

Modeling users' dynamic and evolving preferences from their historical behaviors is challenging and crucial for recommendation systems. Previous methods employ sequential neural networks (e.g., Recurrent Neural Network) …

Recommendation SystemsSequential Recommendation

UniRec: A Dual Enhancement of Uniformity and Frequency in Sequential Recommendations

2024-06-26 · Yang Liu, Yitong Wang, Chenyue Feng

Representation learning in sequential recommendation is critical for accurately modeling user interaction patterns and improving recommendation precision. However, existing approaches predominantly emphasize item-to-item…

Recommendation SystemsRepresentation LearningSequential Recommendation

BERT4Loc: BERT for Location -- POI Recommender System

2022-08-02 · Syed Raza Bashir, Shaina Raza, Vojislav Misic

Recommending points of interest (POIs) is a challenging task that requires extracting comprehensive location data from location-based social media platforms. To provide effective location-based recommendations, it's impo…

Recommendation Systems

Contrastive Learning with Bidirectional Transformers for Sequential Recommendation

2022-08-08 · Hanwen Du, Hui Shi, Pengpeng Zhao, Deqing Wang 외

Contrastive learning with Transformer-based sequence encoder has gained predominance for sequential recommendation. It maximizes the agreements between paired sequence augmentations that share similar semantics. However,…

Contrastive LearningSequential Recommendation

KATRec: Knowledge Aware aTtentive Sequential Recommendations

2020-12-06 · Mehrnaz Amjadi, Seyed Danial Mohseni Taheri, Theja Tulabandhula

Sequential recommendation systems model dynamic preferences of users based on their historical interactions with platforms. Despite recent progress, modeling short-term and long-term behavior of users in such systems is …

Graph AttentionRecommendation SystemsRepresentation LearningSequential Recommendation