A Conformal Prediction Score that is Robust to Label Noise
Conformal Prediction (CP) quantifies network uncertainty by building a small prediction set with a pre-defined probability that the correct class is within this set. In this study we tackle the problem of CP calibration based on a validation set with noisy labels. We introduce a conformal score that is robust to label noise. The noise-free conformal score is estimated using the noisy labeled data and the noise level. In the test phase the noise-free score is used to form the prediction set. We applied the proposed algorithm to several standard medical imaging classification datasets. We show that our method outperforms current methods by a large margin, in terms of the average size of the prediction set, while maintaining the required coverage.
Code (1)
Tasks
Conformal PredictionPredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Label Noise Robustness of Conformal Prediction
We study the robustness of conformal prediction, a powerful tool for uncertainty quantification, to label noise. Our analysis tackles both regression and classification problems, characterizing when and how it is possibl…
Conformal PredictionPredictionregressionUncertainty QuantificationEstimating the Conformal Prediction Threshold from Noisy Labels
Conformal Prediction (CP) is a method to control prediction uncertainty by producing a small prediction set, ensuring a predetermined probability that the true class lies within this set. This is commonly done by definin…
Conformal Predictionimage-classificationImage ClassificationMedical Image Classification+1Robust Online Conformal Prediction under Uniform Label Noise
Conformal prediction is an emerging technique for uncertainty quantification that constructs prediction sets guaranteed to contain the true label with a predefined probability. Recent work develops online conformal predi…
Conformal PredictionPredictionUncertainty QuantificationOne Sample is Enough to Make Conformal Prediction Robust
Given any model, conformal prediction (CP) returns prediction sets guaranteed to include the true label with high adjustable probability. Robust CP (RCP) extends this to inputs with worst-case noise. A well-established a…
Conformal PredictionPredictionPrivacy-Preserving Conformal Prediction Under Local Differential Privacy
Conformal prediction (CP) provides sets of candidate classes with a guaranteed probability of containing the true class. However, it typically relies on a calibration set with clean labels. We address privacy-sensitive s…
Conformal PredictionLarge Language ModelPredictionPrivacy Preserving