Conformal Predictive Systems Under Covariate Shift
Conformal Predictive Systems (CPS) offer a versatile framework for constructing predictive distributions, allowing for calibrated inference and informative decision-making. However, their applicability has been limited to scenarios adhering to the Independent and Identically Distributed (IID) model assumption. This paper extends CPS to accommodate scenarios characterized by covariate shifts. We therefore propose Weighted CPS (WCPS), akin to Weighted Conformal Prediction (WCP), leveraging likelihood ratios between training and testing covariate distributions. This extension enables the construction of nonparametric predictive distributions capable of handling covariate shifts. We present theoretical underpinnings and conjectures regarding the validity and efficacy of WCPS and demonstrate its utility through empirical evaluations on both synthetic and real-world datasets. Our simulation experiments indicate that WCPS are probabilistically calibrated under covariate shift.
Code (1)
Tasks
Conformal PredictionDecision MakingSimilar Papers 제목 키워드 기반
Generalized Conformal Predictive Systems Under Distributional Shifts
Conformal predictive systems (CPS) output calibrated bands of CDFs under exchangeability. We extend generalized CPS to non-exchangeable settings by encoding distributional shifts through observation-specific permutation …
Conformal Prediction for Dose-Response Models with Continuous Treatments
Understanding the dose-response relation between a continuous treatment and the outcome for an individual can greatly drive decision-making, particularly in areas like personalized drug dosing and personalized healthcare…
Conformal PredictionDecision MakingPredictionPrediction Intervals+1Generalization and Informativeness of Weighted Conformal Risk Control Under Covariate Shift
Predictive models are often required to produce reliable predictions under statistical conditions that are not matched to the training data. A common type of training-testing mismatch is covariate shift, where the condit…
InformativenessPredictionvalidTraining-Conditional Coverage Bounds under Covariate Shift
Training-conditional coverage guarantees in conformal prediction concern the concentration of the error distribution, conditional on the training data, below some nominal level. The conformal prediction methodology has r…
Conformal PredictionPredictionConformal Convolution and Monte Carlo Meta-learners for Predictive Inference of Individual Treatment Effects
Generating probabilistic forecasts of potential outcomes and individual treatment effects (ITE) is essential for risk-aware decision-making in domains such as healthcare, policy, marketing, and finance. We propose two no…
Decision MakingMarketingPrediction IntervalsUncertainty Quantification