paper-with-me

Papers

Debiased Contrastive Learning for Sequential Recommendation

2023-03-21 · Yuhao Yang, Chao Huang, Lianghao Xia, Chunzhen Huang, Da Luo, Kangyi Lin

Current sequential recommender systems are proposed to tackle the dynamic user preference learning with various neural techniques, such as Transformer and Graph Neural Networks (GNNs). However, inference from the highly sparse user behavior data may hinder the representation ability of sequential pattern encoding. To address the label shortage issue, contrastive learning (CL) methods are proposed recently to perform data augmentation in two fashions: (i) randomly corrupting the sequence data (e.g. stochastic masking, reordering); (ii) aligning representations across pre-defined contrastive views. Although effective, we argue that current CL-based methods have limitations in addressing popularity bias and disentangling of user conformity and real interest. In this paper, we propose a new Debiased Contrastive learning paradigm for Recommendation (DCRec) that unifies sequential pattern encoding with global collaborative relation modeling through adaptive conformity-aware augmentation. This solution is designed to tackle the popularity bias issue in recommendation systems. Our debiased contrastive learning framework effectively captures both the patterns of item transitions within sequences and the dependencies between users across sequences. Our experiments on various real-world datasets have demonstrated that DCRec significantly outperforms state-of-the-art baselines, indicating its efficacy for recommendation. To facilitate reproducibility of our results, we make our implementation of DCRec publicly available at: https://github.com/HKUDS/DCRec.

📄 PDF Abstract BibTeX arXiv:2303.11780

Code (1)

hkuds/dcrec 공식 구현 pytorch

Tasks

Contrastive LearningData AugmentationRecommendation SystemsSequential Recommendation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Revisiting Recommendation Loss Functions through Contrastive Learning (Technical Report)

2023-12-13 · Dong Li, Ruoming Jin, Bin Ren

Inspired by the success of contrastive learning, we systematically examine recommendation losses, including listwise (softmax), pairwise (BPR), and pointwise (MSE and CCL) losses. In this endeavor, we introduce InfoNCE+,…

Contrastive Learning

(Debiased) Contrastive Learning Loss for Recommendation (Technical Report)

2023-12-13 · Ruoming Jin, Dong Li

In this paper, we perform a systemic examination of the recommendation losses, including listwise (softmax), pairwise(BPR), and pointwise (mean-squared error, MSE, and Cosine Contrastive Loss, CCL) losses through the len…

Contrastive Learning

Debiased Model-based Interactive Recommendation

2024-02-24 · Zijian Li, Ruichu Cai, Haiqin Huang, Sili Zhang 외

Existing model-based interactive recommendation systems are trained by querying a world model to capture the user preference, but learning the world model from historical logged data will easily suffer from bias issues s…

Contrastive LearningInteractive RecommendationmodelRecommendation Systems

TDCGL: Two-Level Debiased Contrastive Graph Learning for Recommendation

2023-10-01 · Yubo Gao, Haotian Wu

knowledge graph-based recommendation methods have achieved great success in the field of recommender systems. However, over-reliance on high-quality knowledge graphs is a bottleneck for such methods. Specifically, the lo…

Contrastive LearningData AugmentationDenoisingGraph Learning+4

Debiased Contrastive Representation Learning for Mitigating Dual Biases in Recommender Systems

2024-08-19 · Zhirong Huang, Shichao Zhang, Debo Cheng, Jiuyong Li 외

In recommender systems, popularity and conformity biases undermine recommender effectiveness by disproportionately favouring popular items, leading to their over-representation in recommendation lists and causing an unba…

Contrastive LearningDiversityRecommendation SystemsRepresentation Learning