Improving Adaptive Conformal Prediction Using Self-Supervised Learning
Conformal prediction is a powerful distribution-free tool for uncertainty quantification, establishing valid prediction intervals with finite-sample guarantees. To produce valid intervals which are also adaptive to the difficulty of each instance, a common approach is to compute normalized nonconformity scores on a separate calibration set. Self-supervised learning has been effectively utilized in many domains to learn general representations for downstream predictors. However, the use of self-supervision beyond model pretraining and representation learning has been largely unexplored. In this work, we investigate how self-supervised pretext tasks can improve the quality of the conformal regressors, specifically by improving the adaptability of conformal intervals. We train an auxiliary model with a self-supervised pretext task on top of an existing predictive model and use the self-supervised error as an additional feature to estimate nonconformity scores. We empirically demonstrate the benefit of the additional information using both synthetic and real data on the efficiency (width), deficit, and excess of conformal prediction intervals.
Code (2)
Tasks
Conformal PredictionPredictionPrediction IntervalsRepresentation LearningSelf-Supervised LearningUncertainty QuantificationvalidSimilar Papers 제목 키워드 기반
Self-supervised conformal prediction for uncertainty quantification in Poisson imaging problems
Image restoration problems are often ill-posed, leading to significant uncertainty in reconstructed images. Accurately quantifying this uncertainty is essential for the reliable interpretation of reconstructed images. Ho…
Conformal PredictionDeblurringDenoisingImage Denoising+3Self-supervised Conformal Prediction for Uncertainty Quantification in Imaging Problems
Most image restoration problems are ill-conditioned or ill-posed and hence involve significant uncertainty. Quantifying this uncertainty is crucial for reliably interpreting experimental results, particularly when recons…
Conformal PredictionDeblurringDenoisingImage Denoising+3SPLICE: Latent Diffusion over JEPA Embeddings for Conformal Time-Series Inpainting
Generative models for time-series imputation achieve strong reconstruction accuracy, yet provide no finite-sample reliability guarantees, a critical limitation in power systems where imputed values inform dispatch and pl…
Towards Reliable Zero Shot Classification in Self-Supervised Models with Conformal Prediction
Self-supervised models trained with a contrastive loss such as CLIP have shown to be very powerful in zero-shot classification settings. However, to be used as a zero-shot classifier these models require the user to prov…
ClassificationConformal PredictionOutlier Detectionzero-shot-classification+1Adaptive Uncertainty Quantification for Generative AI
This work is concerned with conformal prediction in contemporary applications (including generative AI) where a black-box model has been trained on data that are not accessible to the user. Mirroring split-conformal infe…
Conformal PredictionUncertainty Quantification