paper-with-me

홈 › Papers

Prototypical Contrastive Learning through Alignment and Uniformity for Recommendation

2024-02-03 · Yangxun Ou, Lei Chen, Fenglin Pan, Yupeng Wu

Graph Collaborative Filtering (GCF), one of the most widely adopted recommendation system methods, effectively captures intricate relationships between user and item interactions. Graph Contrastive Learning (GCL) based GCF has gained significant attention as it leverages self-supervised techniques to extract valuable signals from real-world scenarios. However, many methods usually learn the instances of discrimination tasks that involve the construction of contrastive pairs through random sampling. GCL approaches suffer from sampling bias issues, where the negatives might have a semantic structure similar to that of the positives, thus leading to a loss of effective feature representation. To address these problems, we present the \underline{Proto}typical contrastive learning through \underline{A}lignment and \underline{U}niformity for recommendation, which is called \textbf{ProtoAU}. Specifically, we first propose prototypes (cluster centroids) as a latent space to ensure consistency across different augmentations from the origin graph, aiming to eliminate the need for random sampling of contrastive pairs. Furthermore, the absence of explicit negatives means that directly optimizing the consistency loss between instance and prototype could easily result in dimensional collapse issues. Therefore, we propose aligning and maintaining uniformity in the prototypes of users and items as optimization objectives to prevent falling into trivial solutions. Finally, we conduct extensive experiments on four datasets and evaluate their performance on the task of link prediction. Experimental results demonstrate that the proposed ProtoAU outperforms other representative methods. The source codes of our proposed ProtoAU are available at \url{https://github.com/oceanlvr/ProtoAU}.

📄 PDF Abstract BibTeX arXiv:2402.02079

Code (1)

oceanlvr/protoau 공식 구현 pytorch

Tasks

Collaborative FilteringContrastive LearningLink Prediction

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Rethinking Prototypical Contrastive Learning through Alignment, Uniformity and Correlation

2022-10-18 · Shentong Mo, Zhun Sun, Chao Li

Contrastive self-supervised learning (CSL) with a prototypical regularization has been introduced in learning meaningful representations for downstream tasks that require strong semantic information. However, to optimize…

Contrastive LearningDiversitySelf-Supervised Learning

TwinCL: A Twin Graph Contrastive Learning Model for Collaborative Filtering

2024-09-27 · Chengkai Liu, Jianling Wang, James Caverlee

In the domain of recommendation and collaborative filtering, Graph Contrastive Learning (GCL) has become an influential approach. Nevertheless, the reasons for the effectiveness of contrastive learning are still not well…

Collaborative FilteringContrastive LearningData Augmentation

uCTRL: Unbiased Contrastive Representation Learning via Alignment and Uniformity for Collaborative Filtering

2023-05-22 · Jae-woong Lee, Seongmin Park, Mincheol Yoon, Jongwuk Lee

Because implicit user feedback for the collaborative filtering (CF) models is biased toward popular items, CF models tend to yield recommendation lists with popularity bias. Previous studies have utilized inverse propens…

Causal InferenceCollaborative FilteringRepresentation Learning

Rethinking Graph Masked Autoencoders through Alignment and Uniformity

2024-02-11 · Xiang Tao, Qiang Liu, Shu Wu, Liang Wang

Self-supervised learning on graphs can be bifurcated into contrastive and generative methods. Contrastive methods, also known as graph contrastive learning (GCL), have dominated graph self-supervised learning in the past…

Contrastive LearningSelf-Supervised Learning

Correlation between Alignment-Uniformity and Performance of Dense Contrastive Representations

2022-10-17 · Jong Hak Moon, Wonjae Kim, Edward Choi

Recently, dense contrastive learning has shown superior performance on dense prediction tasks compared to instance-level contrastive learning. Despite its supremacy, the properties of dense contrastive representations ha…

Contrastive LearningLinear evaluation