paper-with-me

Papers

Local Temperature Scaling for Probability Calibration

2020-08-12 · ICCV 2021 10 · Zhipeng Ding, Xu Han, Peirong Liu, Marc Niethammer

For semantic segmentation, label probabilities are often uncalibrated as they are typically only the by-product of a segmentation task. Intersection over Union (IoU) and Dice score are often used as criteria for segmentation success, while metrics related to label probabilities are not often explored. However, probability calibration approaches have been studied, which match probability outputs with experimentally observed errors. These approaches mainly focus on classification tasks, but not on semantic segmentation. Thus, we propose a learning-based calibration method that focuses on multi-label semantic segmentation. Specifically, we adopt a convolutional neural network to predict local temperature values for probability calibration. One advantage of our approach is that it does not change prediction accuracy, hence allowing for calibration as a post-processing step. Experiments on the COCO, CamVid, and LPBA40 datasets demonstrate improved calibration performance for a range of different metrics. We also demonstrate the good performance of our method for multi-atlas brain segmentation from magnetic resonance images.

📄 PDF Abstract BibTeX arXiv:2008.05105

Code (1)

uncbiag/LTS pytorch

Tasks

Brain SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Calibrating Where It Matters: Constrained Temperature Scaling

2024-06-17 · Stephen McKenna, Jacob Carse

We consider calibration of convolutional classifiers for diagnostic decision making. Clinical decision makers can use calibrated classifiers to minimise expected costs given their own cost function. Such functions are us…

Decision MakingDiagnostic

Calibrating Language Models with Adaptive Temperature Scaling

2024-09-29 · Johnathan Xie, Annie S. Chen, Yoonho Lee, Eric Mitchell 외

The effectiveness of large language models (LLMs) is not only measured by their ability to generate accurate outputs but also by their calibration-how well their confidence scores reflect the probability of their outputs…

Unsupervised Pre-training

Does confidence calibration improve conformal prediction?

2024-02-06 · Huajun Xi, Jianguo Huang, Kangdao Liu, Lei Feng 외

Conformal prediction is an emerging technique for uncertainty quantification that constructs prediction sets guaranteed to contain the true label with a predefined probability. Previous works often employ temperature sca…

Conformal PredictionPredictionUncertainty Quantification

Structured Matrix Scaling for Multi-Class Calibration

2025-11-05 · Eugène Berta, David Holzmüller, Michael I. Jordan, Francis Bach arxiv

Post-hoc recalibration methods are widely used to ensure that classifiers provide faithful probability estimates. We argue that parametric recalibration functions based on logistic regression can be motivated from a simp…

Maximum Spanning Trees Are Invariant to Temperature Scaling in Graph-based Dependency Parsing

2021-06-15 · Stefan Grünewald

Modern graph-based syntactic dependency parsers operate by predicting, for each token within a sentence, a probability distribution over its possible syntactic heads (i.e., all other tokens) and then extracting a maximum…

Dependency ParsingSentence