paper-with-me

홈 › Papers

Fusion Self-supervised Learning for Recommendation

2024-07-29 · Yu Zhang, Lei Sang, Yi Zhang, Yiwen Zhang, Yun Yang

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its robust ability to generate self-supervised signals. Mainstream graph contrastive learning (GCL)-based methods typically implement CL by creating contrastive views through various data augmentation techniques. Despite these methods are effective, we argue that there still exist several challenges. i) Data augmentation ($e.g.,$ discarding edges or adding noise) necessitates additional graph convolution (GCN) or modeling operations, which are highly time-consuming and potentially harm the embedding quality. ii) Existing CL-based methods use traditional CL objectives to capture self-supervised signals. However, few studies have explored obtaining CL objectives from more perspectives and have attempted to fuse the varying signals from these CL objectives to enhance recommendation performance. To overcome these challenges, we propose a Fusion Self-supervised Learning framework for recommendation. Specifically, instead of facilitating data augmentations, we use high-order information from GCN process to create contrastive views. Additionally, to integrate self-supervised signals from various CL objectives, we propose an advanced CL objective. By ensuring that positive pairs are distanced from negative samples derived from both contrastive views, we effectively fuse self-supervised signals from distinct CL objectives, thereby enhancing the mutual information between positive pairs. Experimental results on three public datasets demonstrate the superior recommendation performance and efficiency of HFGCL compared to the state-of-the-art baselines.

📄 PDF Abstract BibTeX arXiv:2407.19692

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningData AugmentationRecommendation SystemsSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization

2020-08-18 · Kun Zhou, Hui Wang, Wayne Xin Zhao, Yutao Zhu 외

Recently, significant progress has been made in sequential recommendation with deep learning. Existing neural sequential recommendation models usually rely on the item prediction loss to learn model parameters or data re…

AttributeSelf-Supervised LearningSequential Recommendation

Automatic Self-supervised Learning for Social Recommendations

2024-12-25 · Xin He, Wenqi Fan, Mingchen Sun, Ying Wang 외

In recent years, researchers have attempted to exploit social relations to improve the performance in recommendation systems. Generally, most existing social recommendation methods heavily depends on substantial domain k…

Meta-LearningRecommendation SystemsRepresentation LearningSelf-Supervised Learning

RDGCL: Reaction-Diffusion Graph Contrastive Learning for Recommendation

2023-12-27 · Jeongwhan Choi, Hyowon Wi, Chaejeong Lee, Sung-Bae Cho 외

Contrastive learning (CL) has emerged as a promising technique for improving recommender systems, addressing the challenge of data sparsity by using self-supervised signals from raw data. Integration of CL with graph con…

Contrastive LearningData IntegrationDiversityRecommendation Systems

SLSREC: Self-Supervised Contrastive Learning for Adaptive Fusion of Long- and Short-Term User Interests

2026-04-06 · Wei Zhou, Yue Shen, Junkai Ji, Yinglan Feng 외 arxiv

User interests typically encompass both long-term preferences and short-term intentions, reflecting the dynamic nature of user behaviors across different timeframes. The uneven temporal distribution of user interactions …

Self-Supervised LearningContrastive Learning

SelfGNN: Self-Supervised Graph Neural Networks for Sequential Recommendation

2024-05-31 · Yuxi Liu, Lianghao Xia, Chao Huang

Sequential recommendation effectively addresses information overload by modeling users' temporal and sequential interaction patterns. To overcome the limitations of supervision signals, recent approaches have adopted sel…

Graph Neural NetworkRecommendation SystemsSelf-Supervised LearningSequential Recommendation