paper-with-me

홈 › Papers

Asymptotically Unbiased Estimation for Delayed Feedback Modeling via Label Correction

2022-02-14 · Yu Chen, Jiaqi Jin, Hui Zhao, Pengjie Wang, Guojun Liu, Jian Xu, Bo Zheng

Alleviating the delayed feedback problem is of crucial importance for the conversion rate(CVR) prediction in online advertising. Previous delayed feedback modeling methods using an observation window to balance the trade-off between waiting for accurate labels and consuming fresh feedback. Moreover, to estimate CVR upon the freshly observed but biased distribution with fake negatives, the importance sampling is widely used to reduce the distribution bias. While effective, we argue that previous approaches falsely treat fake negative samples as real negative during the importance weighting and have not fully utilized the observed positive samples, leading to suboptimal performance. In this work, we propose a new method, DElayed Feedback modeling with UnbiaSed Estimation, (DEFUSE), which aim to respectively correct the importance weights of the immediate positive, the fake negative, the real negative, and the delay positive samples at finer granularity. Specifically, we propose a two-step optimization approach that first infers the probability of fake negatives among observed negatives before applying importance sampling. To fully exploit the ground-truth immediate positives from the observed distribution, we further develop a bi-distribution modeling framework to jointly model the unbiased immediate positives and the biased delay conversions. Experimental results on both public and our industrial datasets validate the superiority of DEFUSE. Codes are available at https://github.com/ychen216/DEFUSE.git.

📄 PDF Abstract BibTeX arXiv:2202.06472

Code (1)

ychen216/defuse 공식 구현 tf

Similar Papers 제목 키워드 기반

Handling many conversions per click in modeling delayed feedback

2021-01-06 · Ashwinkumar Badanidiyuru, Andrew Evdokimov, Vinodh Krishnan, Pan Li 외

Predicting the expected value or number of post-click conversions (purchases or other events) is a key task in performance-based digital advertising. In training a conversion optimizer model, one of the most crucial aspe…

Unbiased Delayed Feedback Label Correction for Conversion Rate Prediction

2023-07-24 · Yifan Wang, Peijie Sun, Min Zhang, Qinglin Jia 외

Conversion rate prediction is critical to many online applications such as digital display advertising. To capture dynamic data distribution, industrial systems often require retraining models on recent data daily or wee…

counterfactual

Delayed Feedback Modeling for Post-Click Gross Merchandise Volume Prediction: Benchmark, Insights and Approaches

2026-01-28 · Xinyu Li, Sishuo Chen, Guipeng Xv, Li Zhang 외 arxiv

The prediction objectives of online advertisement ranking models are evolving from probabilistic metrics like conversion rate (CVR) to numerical business metrics like post-click gross merchandise volume (GMV). Unlike the…

Best arm identification in multi-armed bandits with delayed feedback

2018-03-29 · Aditya Grover, Todor Markov, Peter Attia, Norman Jin 외

We propose a generalization of the best arm identification problem in stochastic multi-armed bandits (MAB) to the setting where every pull of an arm is associated with delayed feedback. The delay in feedback increases th…

Hyperparameter OptimizationMulti-Armed Bandits

A Misuse of Specification Tests

2022-11-21 · Naoya Sueishi

Empirical researchers often perform model specification tests, such as the Hausman test and the overidentifying restrictions test, to confirm the validity of estimators rather than the validity of models. This paper exam…

valid