Training-Conditional Coverage Bounds under Covariate Shift
Training-conditional coverage guarantees in conformal prediction concern the concentration of the error distribution, conditional on the training data, below some nominal level. The conformal prediction methodology has recently been generalized to the covariate shift setting, namely, the covariate distribution changes between the training and test data. In this paper, we study the training-conditional coverage properties of a range of conformal prediction methods under covariate shift via a weighted version of the Dvoretzky-Kiefer-Wolfowitz (DKW) inequality tailored for distribution change. The result for the split conformal method is almost assumption-free, while the results for the full conformal and jackknife+ methods rely on strong assumptions including the uniform stability of the training algorithm.
Code (0)
등록된 구현이 없습니다.
Tasks
Conformal PredictionPredictionSimilar Papers 제목 키워드 기반
Beyond Marginal Validity: Finite-Sample Guarantees for Localized Conformal Prediction
Conformal prediction endows arbitrary black-box predictors with finite-sample, distribution-free marginal coverage, yet marginal validity can hide severe covariate-specific miscalibration, while exact distribution-free c…
Conformalized Survival Analysis
Existing survival analysis techniques heavily rely on strong modelling assumptions and are, therefore, prone to model misspecification errors. In this paper, we develop an inferential method based on ideas from conformal…
Conformal PredictionPrediction IntervalsSurvival AnalysisSurvival Prediction+1Training-Conditional Coverage Bounds for Uniformly Stable Learning Algorithms
The training-conditional coverage performance of the conformal prediction is known to be empirically sound. Recently, there have been efforts to support this observation with theoretical guarantees. The training-conditio…
Conformal PredictionPredictionGeneralized Lee Bounds
Lee (2009) is a common approach to bound the average causal effect in the presence of selection bias, assuming the treatment effect on selection has the same sign for all subjects. This paper generalizes Lee bounds to al…
Selection biasKandinsky Conformal Prediction: Beyond Class- and Covariate-Conditional Coverage
Conformal prediction is a powerful distribution-free framework for constructing prediction sets with coverage guarantees. Classical methods, such as split conformal prediction, provide marginal coverage, ensuring that th…
Conformal PredictionPrediction