paper-with-me

홈 › Papers

Self-supervised Graph Learning for Recommendation

2020-10-21 · Jiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He, Liang Chen, Jianxun Lian, Xing Xie

Representation learning on user-item graph for recommendation has evolved from using single ID or interaction history to exploiting higher-order neighbors. This leads to the success of graph convolution networks (GCNs) for recommendation such as PinSage and LightGCN. Despite effectiveness, we argue that they suffer from two limitations: (1) high-degree nodes exert larger impact on the representation learning, deteriorating the recommendations of low-degree (long-tail) items; and (2) representations are vulnerable to noisy interactions, as the neighborhood aggregation scheme further enlarges the impact of observed edges. In this work, we explore self-supervised learning on user-item graph, so as to improve the accuracy and robustness of GCNs for recommendation. The idea is to supplement the classical supervised task of recommendation with an auxiliary self-supervised task, which reinforces node representation learning via self-discrimination. Specifically, we generate multiple views of a node, maximizing the agreement between different views of the same node compared to that of other nodes. We devise three operators to generate the views -- node dropout, edge dropout, and random walk -- that change the graph structure in different manners. We term this new learning paradigm as \textit{Self-supervised Graph Learning} (SGL), implementing it on the state-of-the-art model LightGCN. Through theoretical analyses, we find that SGL has the ability of automatically mining hard negatives. Empirical studies on three benchmark datasets demonstrate the effectiveness of SGL, which improves the recommendation accuracy, especially on long-tail items, and the robustness against interaction noises. Our implementations are available at \url{https://github.com/wujcan/SGL}.

📄 PDF Abstract BibTeX arXiv:2010.10783

Code (3)

wujcan/SGL 공식 구현 tf
hkuds/sslrec pytorch
wujcan/sgl-torch pytorch

Tasks

Collaborative FilteringGraph LearningRepresentation LearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

LightGCN LightGCN is a type of graph convolutional neural network (GCN), including only the most essential component in GCN (neighborhood…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Self-Supervised Graph Co-Training for Session-based Recommendation

2021-08-24 · Xin Xia, Hongzhi Yin, Junliang Yu, Yingxia Shao 외

Session-based recommendation targets next-item prediction by exploiting user behaviors within a short time period. Compared with other recommendation paradigms, session-based recommendation suffers more from the problem …

Contrastive LearningData AugmentationSelf-Supervised LearningSession-Based Recommendations

SGCL: Unifying Self-Supervised and Supervised Learning for Graph Recommendation

2025-07-17 · Weizhi Zhang, Liangwei Yang, Zihe Song, Henrry Peng Zou 외

Recommender systems (RecSys) are essential for online platforms, providing personalized suggestions to users within a vast sea of information. Self-supervised graph learning seeks to harness high-order collaborative filt…

Collaborative FilteringContrastive LearningGraph LearningMulti-Task Learning+1

Self-supervised Graph-based Point-of-interest Recommendation

2022-10-22 · Yang Li, Tong Chen, Peng-Fei Zhang, Zi Huang 외

The exponential growth of Location-based Social Networks (LBSNs) has greatly stimulated the demand for precise location-based recommendation services. Next Point-of-Interest (POI) recommendation, which aims to provide pe…

Self-Supervised Learning

MENTOR: Multi-level Self-supervised Learning for Multimodal Recommendation

2024-02-29 · Jinfeng Xu, Zheyu Chen, Shuo Yang, Jinze Li 외

With the increasing multimedia information, multimodal recommendation has received extensive attention. It utilizes multimodal information to alleviate the data sparsity problem in recommendation systems, thus improving …

cross-modal alignmentMultimodal RecommendationRecommendation SystemsSelf-Supervised Learning

Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendation

2021-01-16 · Junliang Yu, Hongzhi Yin, Jundong Li, Qinyong Wang 외

Social relations are often used to improve recommendation quality when user-item interaction data is sparse in recommender systems. Most existing social recommendation models exploit pairwise relations to mine potential …

Recommendation SystemsSelf-Supervised Learning