paper-with-me

Papers

Parameterized Temperature Scaling for Boosting the Expressive Power in Post-Hoc Uncertainty Calibration

2021-02-24 · Christian Tomani, Daniel Cremers, Florian Buettner

We address the problem of uncertainty calibration and introduce a novel calibration method, Parametrized Temperature Scaling (PTS). Standard deep neural networks typically yield uncalibrated predictions, which can be transformed into calibrated confidence scores using post-hoc calibration methods. In this contribution, we demonstrate that the performance of accuracy-preserving state-of-the-art post-hoc calibrators is limited by their intrinsic expressive power. We generalize temperature scaling by computing prediction-specific temperatures, parameterized by a neural network. We show with extensive experiments that our novel accuracy-preserving approach consistently outperforms existing algorithms across a large number of model architectures, datasets and metrics.

📄 PDF Abstract BibTeX arXiv:2102.12182

Code (1)

tochris/pts-uncertainty 공식 구현 tf

Similar Papers 제목 키워드 기반

Adaptive Temperature Scaling for Robust Calibration of Deep Neural Networks

2022-07-31 · Sergio A. Balanya, Juan Maroñas, Daniel Ramos

In this paper, we study the post-hoc calibration of modern neural networks, a problem that has drawn a lot of attention in recent years. Many calibration methods of varying complexity have been proposed for the task, but…

Inductive BiasMedical Diagnosis

On the Role of Temperature Sampling in Test-Time Scaling

2025-10-02 · Yuheng Wu, Azalia Mirhoseini, Thierry Tambe arxiv

Large language models (LLMs) can improve reasoning at inference time through test-time scaling (TTS), where multiple reasoning traces are generated and the best one is selected. Prior work shows that increasing the numbe…

Reinforcement Learning

Quantile Adaptive Temperature Scaling for Confidence Calibration

2026-06-19 · Omprakash Chakraborty, Leo Fillioux, Ismail Ben Ayed, Jose Dolz arxiv

Deep neural networks often produce poorly calibrated confidence estimates, overstating their certainty even when predictions are incorrect. Temperature Scaling remains the most widely used posthoc calibration method due …

Improving Semantic Uncertainty Quantification in Language Model Question-Answering via Token-Level Temperature Scaling

2026-04-08 · Tom A. Lamb, Desi R. Ivanova, Philip H. S. Torr, Tim G. J. Rudner arxiv

Calibration is central to reliable semantic uncertainty quantification, yet prior work has largely focused on discrimination, neglecting calibration. As calibration and discrimination capture distinct aspects of uncertai…

The good, the bad and the ugly sides of data augmentation: An implicit spectral regularization perspective

2022-10-10 · Chi-Heng Lin, Chiraag Kaushik, Eva L. Dyer, Vidya Muthukumar

Data augmentation (DA) is a powerful workhorse for bolstering performance in modern machine learning. Specific augmentations like translations and scaling in computer vision are traditionally believed to improve generali…

Data Augmentationregression