Informativeness of Weighted Conformal Prediction
Weighted conformal prediction (WCP), a recently proposed framework, provides uncertainty quantification with the flexibility to accommodate different covariate distributions between training and test data. However, it is pointed out in this paper that the effectiveness of WCP heavily relies on the overlap between covariate distributions; insufficient overlap can lead to uninformative prediction intervals. To enhance the informativeness of WCP, we propose two methods for scenarios involving multiple sources with varied covariate distributions. We establish theoretical guarantees for our proposed methods and demonstrate their efficacy through simulations.
Code (1)
Tasks
Conformal PredictionInformativenessPredictionPrediction IntervalsUncertainty QuantificationSimilar Papers 제목 키워드 기반
Weighted Aggregation of Conformity Scores for Classification
Conformal prediction is a powerful framework for constructing prediction sets with valid coverage guarantees in multi-class classification. However, existing methods often rely on a single score function, which can limit…
ClassificationConformal PredictionInformativenessMulti-class Classification+2Generalization and Informativeness of Weighted Conformal Risk Control Under Covariate Shift
Predictive models are often required to produce reliable predictions under statistical conditions that are not matched to the training data. A common type of training-testing mismatch is covariate shift, where the condit…
InformativenessPredictionvalidGeneralization and Informativeness of Conformal Prediction
The safe integration of machine learning modules in decision-making processes hinges on their ability to quantify uncertainty. A popular technique to achieve this goal is conformal prediction (CP), which transforms an ar…
Conformal PredictionDecision MakingInformativenessPredictionThe Penalized Inverse Probability Measure for Conformal Classification
The deployment of safe and trustworthy machine learning systems, and particularly complex black box neural networks, in real-world applications requires reliable and certified guarantees on their performance. The conform…
ClassificationConformal Predictionimage-classificationImage Classification+1Non-Asymptotic Analysis of Efficiency in Conformalized Regression
Conformal prediction provides prediction sets with coverage guarantees. The informativeness of conformal prediction depends on its efficiency, typically quantified by the expected size of the prediction set. Prior work o…