paper-with-me

홈 › Papers

UFNRec: Utilizing False Negative Samples for Sequential Recommendation

2022-08-08 · Xiaoyang Liu, Chong Liu, Pinzheng Wang, Rongqin Zheng, Lixin Zhang, Leyu Lin, Zhijun Chen, Liangliang Fu

Sequential recommendation models are primarily optimized to distinguish positive samples from negative ones during training in which negative sampling serves as an essential component in learning the evolving user preferences through historical records. Except for randomly sampling negative samples from a uniformly distributed subset, many delicate methods have been proposed to mine negative samples with high quality. However, due to the inherent randomness of negative sampling, false negative samples are inevitably collected in model training. Current strategies mainly focus on removing such false negative samples, which leads to overlooking potential user interests, lack of recommendation diversity, less model robustness, and suffering from exposure bias. To this end, we propose a novel method that can Utilize False Negative samples for sequential Recommendation (UFNRec) to improve model performance. We first devise a simple strategy to extract false negative samples and then transfer these samples to positive samples in the following training process. Furthermore, we construct a teacher model to provide soft labels for false negative samples and design a consistency loss to regularize the predictions of these samples from the student model and the teacher model. To the best of our knowledge, this is the first work to utilize false negative samples instead of simply removing them for the sequential recommendation. Experiments on three benchmark public datasets are conducted using three widely applied SOTA models. The experiment results demonstrate that our proposed UFNRec can effectively draw information from false negative samples and further improve the performance of SOTA models. The code is available at https://github.com/UFNRec-code/UFNRec.

📄 PDF Abstract BibTeX arXiv:2208.04116

Code (1)

ufnrec-code/ufnrec 공식 구현 pytorch

Tasks

Sequential Recommendation

Similar Papers 제목 키워드 기반

MSVQ: Self-Supervised Learning with Multiple Sample Views and Queues

2023-05-09 · Chen Peng, Xianzhong Long, Yun Li

Self-supervised methods based on contrastive learning have achieved great success in unsupervised visual representation learning. However, most methods under this framework suffer from the problem of false negative sampl…

Contrastive LearningRepresentation LearningSelf-Supervised Learning

Graph Ranking Contrastive Learning: A Extremely Simple yet Efficient Method

2023-10-23 · Yulan Hu, Sheng Ouyang, Jingyu Liu, Ge Chen 외

Graph contrastive learning (GCL) has emerged as a representative graph self-supervised method, achieving significant success. The currently prevalent optimization objective for GCL is InfoNCE. Typically, it employs augme…

Contrastive LearningGraph LearningGraph Ranking

Integrating Language Guidance Into Image-Text Matching for Correcting False Negatives

2023-03-24 · IEEE Transactions on Multimedia 2023 3 · Zheng Li, Caili Guo, Zerun Feng, Jenq-Neng Hwang 외

Image-Text Matching (ITM) aims to establish the correspondence between images and sentences. ITM is fundamental to various vision and language understanding tasks. However, there are limitations in the way existing ITM b…

Cross-modal retrieval with noisy correspondenceImage-text matchingSentenceText Matching

Intent-Enhanced Data Augmentation for Sequential Recommendation

2024-10-11 · Shuai Chen, Zhoujun Li

The research on intent-enhanced sequential recommendation algorithms focuses on how to better mine dynamic user intent based on user behavior data for sequential recommendation tasks. Various data augmentation methods ar…

Contrastive LearningData AugmentationSequential Recommendation

Entity Aware Negative Sampling with Auxiliary Loss of False Negative Prediction for Knowledge Graph Embedding

2022-10-12 · Sang-hyun Je

Knowledge graph (KG) embedding is widely used in many downstream applications using KGs. Generally, since KGs contain only ground truth triples, it is necessary to construct arbitrary negative samples for representation …

Graph EmbeddingKnowledge Graph EmbeddingRepresentation Learning