Bayesian Negative Sampling for Recommendation
How to sample high quality negative instances from unlabeled data, i.e., negative sampling, is important for training implicit collaborative filtering and contrastive learning models. Although previous studies have proposed some approaches to sample informative instances, few has been done to discriminating false negative from true negative for unbiased negative sampling. On the basis of our order relation analysis of negatives' scores, we first derive the class conditional density of true negatives and that of false negatives. We next design a Bayesian classifier for negative classification, from which we define a model-agnostic posterior probability estimate of an instance being true negative as a quantitative negative signal measure. We also propose a Bayesian optimal sampling rule to sample high-quality negatives. The proposed Bayesian Negative Sampling (BNS) algorithm has a linear time complexity. Experimental studies validate the superiority of BNS over the peers in terms of better sampling quality and better recommendation performance.
Code (1)
Tasks
Collaborative FilteringContrastive LearningInformativenessMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Enhanced Bayesian Personalized Ranking for Robust Hard Negative Sampling in Recommender Systems
In implicit collaborative filtering, hard negative mining techniques are developed to accelerate and enhance the recommendation model learning. However, the inadvertent selection of false negatives remains a major concer…
Collaborative FilteringRecommendation SystemsOn the Theories Behind Hard Negative Sampling for Recommendation
Negative sampling has been heavily used to train recommender models on large-scale data, wherein sampling hard examples usually not only accelerates the convergence but also improves the model accuracy. Nevertheless, the…
Recommendation SystemsRegion or Global? A Principle for Negative Sampling in Graph-based Recommendation
Graph-based recommendation systems are blossoming recently, which models user-item interactions as a user-item graph and utilizes graph neural networks (GNNs) to learn the embeddings for users and items. A fundamental ch…
Recommendation SystemsNegative Sampling in Recommendation: A Survey and Future Directions
Recommender systems aim to capture users' personalized preferences from the cast amount of user behaviors, making them pivotal in the era of information explosion. However, the presence of the dynamic preference, the "in…
Recommendation SystemsSurveyImproved Estimation of Ranks for Learning Item Recommenders with Negative Sampling
In recommendation systems, there has been a growth in the number of recommendable items (# of movies, music, products). When the set of recommendable items is large, training and evaluation of item recommendation models …
Recommendation Systems