Conformal Risk Control for Ordinal Classification
As a natural extension to the standard conformal prediction method, several conformal risk control methods have been recently developed and applied to various learning problems. In this work, we seek to control the conformal risk in expectation for ordinal classification tasks, which have broad applications to many real problems. For this purpose, we firstly formulated the ordinal classification task in the conformal risk control framework, and provided theoretic risk bounds of the risk control method. Then we proposed two types of loss functions specially designed for ordinal classification tasks, and developed corresponding algorithms to determine the prediction set for each case to control their risks at a desired level. We demonstrated the effectiveness of our proposed methods, and analyzed the difference between the two types of risks on three different datasets, including a simulated dataset, the UTKFace dataset and the diabetic retinopathy detection dataset.
Code (1)
Tasks
ClassificationConformal PredictionDiabetic Retinopathy DetectionOrdinal ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Reliable Conformal Prediction for Ordinal Classification Using the Ranked Probability Score
Ordinal classification (OC) arises in high-stakes domains such as medicine and finance, where uncertainty quantification must account for the severity of ordinal errors. Conformal prediction (CP) provides distribution-fr…
Ordinal ClassificationDistribution-free Conformal Prediction for Ordinal Classification
Conformal prediction is a general distribution-free approach for constructing prediction sets combined with any machine learning algorithm that achieve valid marginal or conditional coverage in finite samples. Ordinal cl…
ClassificationConformal PredictionOrdinal ClassificationPrediction+1Provably Minimum-Length Conformal Prediction Sets for Ordinal Classification
Ordinal classification has been widely applied in many high-stakes applications, e.g., medical imaging and diagnosis, where reliable uncertainty quantification (UQ) is essential for decision making. Conformal prediction …
Ordinal ClassificationDecision MakingConformal Prediction Sets for Ordinal Classification
Ordinal classification (OC), i.e., labeling instances along classes with a natural ordering, is common in multiple applications such as size or budget based recommendations and disease severity labeling. Often in pract…
Conformal Risk Control for Non-Monotonic Losses
Conformal risk control is an extension of conformal prediction for controlling risk functions beyond miscoverage. The original algorithm controls the expected value of a loss that is monotonic in a one-dimensional parame…
Image Classification