Improving Contrastive Learning with Model Augmentation
The sequential recommendation aims at predicting the next items in user behaviors, which can be solved by characterizing item relationships in sequences. Due to the data sparsity and noise issues in sequences, a new self-supervised learning (SSL) paradigm is proposed to improve the performance, which employs contrastive learning between positive and negative views of sequences. However, existing methods all construct views by adopting augmentation from data perspectives, while we argue that 1) optimal data augmentation methods are hard to devise, 2) data augmentation methods destroy sequential correlations, and 3) data augmentation fails to incorporate comprehensive self-supervised signals. Therefore, we investigate the possibility of model augmentation to construct view pairs. We propose three levels of model augmentation methods: neuron masking, layer dropping, and encoder complementing. This work opens up a novel direction in constructing views for contrastive SSL. Experiments verify the efficacy of model augmentation for the SSL in the sequential recommendation. Code is available\footnote{\url{https://github.com/salesforce/SRMA}}.
Code (1)
Tasks
Contrastive LearningData AugmentationmodelSelf-Supervised LearningSequential RecommendationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adversarial Learning Data Augmentation for Graph Contrastive Learning in Recommendation
Recently, Graph Neural Networks (GNNs) achieve remarkable success in Recommendation. To reduce the influence of data sparsity, Graph Contrastive Learning (GCL) is adopted in GNN-based CF methods for enhancing performance…
Contrastive LearningData AugmentationEnhancing Contrastive Link Prediction With Edge Balancing Augmentation
Link prediction is one of the most fundamental tasks in graph mining, which motivates the recent studies of leveraging contrastive learning to enhance the performance. However, we observe two major weaknesses of these st…
Contrastive LearningLink PredictionSensor Data Augmentation by Resampling for Contrastive Learning in Human Activity Recognition
While deep learning has contributed to the advancement of sensor-based Human Activity Recognition (HAR), it is usually a costly and challenging supervised task with the needs of a large amount of labeled data. To allevia…
Activity RecognitionContrastive LearningData AugmentationHuman Activity RecognitionGenerative Contrastive Graph Learning for Recommendation
By treating users' interactions as a user-item graph, graph learning models have been widely deployed in Collaborative Filtering(CF) based recommendation. Recently, researchers have introduced Graph Contrastive Learning(…
Collaborative FilteringContrastive LearningData AugmentationGraph Learning+1Stronger is not better: Better Augmentations in Contrastive Learning for Medical Image Segmentation
Self-supervised contrastive learning is among the recent representation learning methods that have shown performance gains in several downstream tasks including semantic segmentation. This paper evaluates strong data aug…
Medical Image SegmentationRepresentation LearningSemantic SegmentationContrastive Learning