Temperature Scaling for Quantile Calibration
Deep learning models are often poorly calibrated, i.e., they may produce overconfident predictions that are wrong, implying that their uncertainty estimates are unreliable. While a number of approaches have been proposed recently to calibrate classification models, relatively little work exists on calibrating regression models. Temperature Scaling is one of the most popular methods for \emph{classification calibration}. It performs better than or equal to more sophisticated methods. We investigate the use of Temperature Scaling for \emph{regression calibration} under notion of quantile calibration.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationregressionSimilar Papers 제목 키워드 기반
Quantile Adaptive Temperature Scaling for Confidence Calibration
Deep neural networks often produce poorly calibrated confidence estimates, overstating their certainty even when predictions are incorrect. Temperature Scaling remains the most widely used posthoc calibration method due …
Improving Calibration by Relating Focal Loss, Temperature Scaling, and Properness
Proper losses such as cross-entropy incentivize classifiers to produce class probabilities that are well-calibrated on the training data. Due to the generalization gap, these classifiers tend to become overconfident on t…
image-classificationImage ClassificationWell-calibrated Model Uncertainty with Temperature Scaling for Dropout Variational Inference
Model uncertainty obtained by variational Bayesian inference with Monte Carlo dropout is prone to miscalibration. The uncertainty does not represent the model error well. In this paper, temperature scaling is extended to…
Bayesian InferenceVariational InferenceDual-Branch Temperature Scaling Calibration for Long-Tailed Recognition
The calibration for deep neural networks is currently receiving widespread attention and research. Miscalibration usually leads to overconfidence of the model. While, under the condition of long-tailed distribution of da…
Parameterized Temperature Scaling for Boosting the Expressive Power in Post-Hoc Uncertainty Calibration
We address the problem of uncertainty calibration and introduce a novel calibration method, Parametrized Temperature Scaling (PTS). Standard deep neural networks typically yield uncalibrated predictions, which can be tra…