paper-with-me

Papers

A Comprehensive Survey on Self-Supervised Learning for Recommendation

2024-04-04 · Xubin Ren, Wei Wei, Lianghao Xia, Chao Huang

Recommender systems play a crucial role in tackling the challenge of information overload by delivering personalized recommendations based on individual user preferences. Deep learning techniques, such as RNNs, GNNs, and Transformer architectures, have significantly propelled the advancement of recommender systems by enhancing their comprehension of user behaviors and preferences. However, supervised learning methods encounter challenges in real-life scenarios due to data sparsity, resulting in limitations in their ability to learn representations effectively. To address this, self-supervised learning (SSL) techniques have emerged as a solution, leveraging inherent data structures to generate supervision signals without relying solely on labeled data. By leveraging unlabeled data and extracting meaningful representations, recommender systems utilizing SSL can make accurate predictions and recommendations even when confronted with data sparsity. In this paper, we provide a comprehensive review of self-supervised learning frameworks designed for recommender systems, encompassing a thorough analysis of over 170 papers. We conduct an exploration of nine distinct scenarios, enabling a comprehensive understanding of SSL-enhanced recommenders in different contexts. For each domain, we elaborate on different self-supervised learning paradigms, namely contrastive learning, generative learning, and adversarial learning, so as to present technical details of how SSL enhances recommender systems in various contexts. We consistently maintain the related open-source materials at https://github.com/HKUDS/Awesome-SSLRec-Papers.

📄 PDF Abstract BibTeX arXiv:2404.03354

Code (1)

hkuds/awesome-sslrec-papers 공식 구현

Tasks

Contrastive LearningRecommendation SystemsSelf-Supervised LearningSurvey

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Contrastive Self-supervised Learning in Recommender Systems: A Survey

2023-03-17 · Mengyuan Jing, Yanmin Zhu, Tianzi Zang, Ke Wang

Deep learning-based recommender systems have achieved remarkable success in recent years. However, these methods usually heavily rely on labeled data (i.e., user-item interactions), suffering from problems such as data s…

Recommendation SystemsSelf-Supervised LearningSurvey

Self-Supervised Learning for Recommender Systems: A Survey

2022-03-29 · Junliang Yu, Hongzhi Yin, Xin Xia, Tong Chen 외

In recent years, neural architecture-based recommender systems have achieved tremendous success, but they still fall short of expectation when dealing with highly sparse data. Self-supervised learning (SSL), as an emergi…

Recommendation SystemsSelf-Supervised LearningSurvey

Embedding in Recommender Systems: A Survey

2023-10-28 · Xiangyu Zhao, Maolin Wang, Xinjian Zhao, Jiansheng Li 외

Recommender systems have become an essential component of many online platforms, providing personalized recommendations to users. A crucial aspect is embedding techniques that coverts the high-dimensional discrete featur…

AutoMLCollaborative FilteringQuantizationRecommendation Systems+2

A Survey on Large Language Models for Recommendation

2023-05-31 · Likang Wu, Zhi Zheng, Zhaopeng Qiu, Hao Wang 외

Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS). These models, tra…

Recommendation SystemsSelf-Supervised LearningSurvey

Automatic Self-supervised Learning for Social Recommendations

2024-12-25 · Xin He, Wenqi Fan, Mingchen Sun, Ying Wang 외

In recent years, researchers have attempted to exploit social relations to improve the performance in recommendation systems. Generally, most existing social recommendation methods heavily depends on substantial domain k…

Meta-LearningRecommendation SystemsRepresentation LearningSelf-Supervised Learning