UKD: Debiasing Conversion Rate Estimation via Uncertainty-regularized Knowledge Distillation
In online advertising, conventional post-click conversion rate (CVR) estimation models are trained using clicked samples. However, during online serving the models need to estimate for all impression ads, leading to the sample selection bias (SSB) issue. Intuitively, providing reliable supervision signals for unclicked ads is a feasible way to alleviate the SSB issue. This paper proposes an uncertainty-regularized knowledge distillation (UKD) framework to debias CVR estimation via distilling knowledge from unclicked ads. A teacher model learns click-adaptive representations and produces pseudo-conversion labels on unclicked ads as supervision signals. Then a student model is trained on both clicked and unclicked ads with knowledge distillation, performing uncertainty modeling to alleviate the inherent noise in pseudo-labels. Experiments on billion-scale datasets show that UKD outperforms previous debiasing methods. Online results verify that UKD achieves significant improvements.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge DistillationSelection biasMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Uncertainty Calibration for Counterfactual Propensity Estimation in Recommendation
Post-click conversion rate (CVR) is a reliable indicator of online customers' preferences, making it crucial for developing recommender systems. A major challenge in predicting CVR is severe selection bias, arising from …
counterfactualGeneralization BoundsImputationRecommendation Systems+1Uncertainty Calibration for Ensemble-Based Debiasing Methods
Ensemble-based debiasing methods have been shown effective in mitigating the reliance of classifiers on specific dataset bias, by exploiting the output of a bias-only model to adjust the learning target. In this paper, w…
Fact VerificationLarge-scale Causal Approaches to Debiasing Post-click Conversion Rate Estimation with Multi-task Learning
Post-click conversion rate (CVR) estimation is a critical task in e-commerce recommender systems. This task is deemed quite challenging under the industrial setting with two major issues: 1) selection bias caused by user…
Multi-Task LearningRecommendation SystemsSelection biasDebiasing Sequential Recommenders through Distributionally Robust Optimization over System Exposure
Sequential recommendation (SR) models are typically trained on user-item interactions which are affected by the system exposure bias, leading to the user preference learned from the biased SR model not being fully consis…
Sequential RecommendationA Generalized Doubly Robust Learning Framework for Debiasing Post-Click Conversion Rate Prediction
Post-click conversion rate (CVR) prediction is an essential task for discovering user interests and increasing platform revenues in a range of industrial applications. One of the most challenging problems of this task is…
Generalization BoundsImputationSelection bias