paper-with-me

홈 › Papers

Decision-Calibrated Conformal Uncertainty for Pacing Decisions in Streaming Advertising

2026-06-08 · Prashant Shekhar, Caroline Howard arxiv

We develop a decision-calibrated conformal framework for pacing decisions in streaming advertising. Pacing depends on uncertain future inventory, demand pressure, incremental response, and member-experience load. Instead of calibrating a generic forecast residual, the framework measures forecast error by its largest impact on the policies that could actually be deployed. The main theorem shows that the proposed score is the smallest valid uncertainty measure that uniformly protects all deployable pacing policies. Geometrically, it is the support function of the signed policy sensitivity set. Split conformal calibration gives finite-sample coverage for this score. A high-dimensional separation theorem shows that traditional residual calibration can be arbitrarily more conservative by paying for nuisance inventory dimensions, and a robust pacing result combines inventory, response, and experience uncertainty. On public-data-calibrated pacing replays built from Criteo Uplift and KuaiRand datasets, traditional conformal pacing remains unresolved with high residual radii of 7236.7 on Criteo and 4629.4 on KuaiRand. With the proposed decision calibration approach, the uncertainty radii are reduced to 18.4 and 278.6 respectively, with separate margins for value, delivery, budget, and member load. On Criteo, the proposed method certifies a less aggressive pacing policy than the point-forecast baseline, and reduces held-out any-violation rate from 16.7% to 3.3%, with zero budget and member-load violations. On KuaiRand, the choice remains unresolved. In a nutshell, the paper establishes that forecasts, response estimates, and member-experience models should be judged by whether they shrink the uncertainty that the pacing decision uses, as this leads to confident decisions that are not overly conservative.

📄 PDF Abstract BibTeX arXiv:2606.10187

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Conformal Prediction and Human Decision Making

2025-03-12 · Jessica Hullman, Yifan Wu, Dawei Xie, Ziyang Guo 외

Methods to quantify uncertainty in predictions from arbitrary models are in demand in high-stakes domains like medicine and finance. Conformal prediction has emerged as a popular method for producing a set of predictions…

Conformal PredictionDecision MakingPredictionUncertainty Quantification

Calibrating AI Models for Wireless Communications via Conformal Prediction

2022-12-15 · Kfir M. Cohen, Sangwoo Park, Osvaldo Simeone, Shlomo Shamai

When used in complex engineered systems, such as communication networks, artificial intelligence (AI) models should be not only as accurate as possible, but also well calibrated. A well-calibrated AI model is one that ca…

Conformal PredictionPrediction

Conformal Uncertainty Sets for Robust Optimization

2021-05-31 · Chancellor Johnstone, Bruce Cox

Decision-making under uncertainty is hugely important for any decisions sensitive to perturbations in observed data. One method of incorporating uncertainty into making optimal decisions is through robust optimization, w…

Conformal PredictionDecision MakingDecision Making Under UncertaintyMulti-target regression+2

CASCADE Conformal Prediction: Uncertainty-Adaptive Prediction Intervals for Two-Stage Clinical Decision Support

2026-05-19 · Ricardo Diaz-Rincon, Muxuan Liang, Adolfo Ramirez-Zamora, Benjamin Shickel arxiv

Effective medication management in Parkinson's Disease (PD) is challenging due to heterogeneous disease progression, variable patient response, and medication side effects. While AI models can forecast levodopa equivalen…

Distribution-Free Robust Predict-Then-Optimize in Function Spaces

2026-02-09 · Yash Patel, Ambuj Tewari arxiv

The need to rapidly solve PDEs in engineering design workflows has spurred the rise of neural surrogate models. In particular, neural operator models provide a discretization-invariant surrogate by retaining the infinite…