Improved Trainable Calibration Method for Neural Networks on Medical Imaging Classification
Recent works have shown that deep neural networks can achieve super-human performance in a wide range of image classification tasks in the medical imaging domain. However, these works have primarily focused on classification accuracy, ignoring the important role of uncertainty quantification. Empirically, neural networks are often miscalibrated and overconfident in their predictions. This miscalibration could be problematic in any automatic decision-making system, but we focus on the medical field in which neural network miscalibration has the potential to lead to significant treatment errors. We propose a novel calibration approach that maintains the overall classification accuracy while significantly improving model calibration. The proposed approach is based on expected calibration error, which is a common metric for quantifying miscalibration. Our approach can be easily integrated into any classification task as an auxiliary loss term, thus not requiring an explicit training round for calibration. We show that our approach reduces calibration error significantly across various architectures and datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDecision MakingGeneral Classificationimage-classificationImage ClassificationUncertainty QuantificationSimilar Papers 제목 키워드 기반
A Comparative Study of Confidence Calibration in Deep Learning: From Computer Vision to Medical Imaging
Although deep learning prediction models have been successful in the discrimination of different classes, they can often suffer from poor calibration across challenging domains including healthcare. Moreover, the long-ta…
Disease Predictionimage-classificationImage ClassificationPredictionFailure Detection in Medical Image Classification: A Reality Check and Benchmarking Testbed
Failure detection in automated image classification is a critical safeguard for clinical deployment. Detected failure cases can be referred to human assessment, ensuring patient safety in computer-aided clinical decision…
BenchmarkingBinary ClassificationDecision MakingGeneral Classification+4Inter-Camera Color Correction for Multispectral Imaging with Camera Arrays Using a Consensus Image
This paper introduces a novel method for inter-camera color calibration for multispectral imaging with camera arrays using a consensus image. Capturing images using multispectral camera arrays has gained importance in me…
Mitigating Calibration Bias Without Fixed Attribute Grouping for Improved Fairness in Medical Imaging Analysis
Trustworthy deployment of deep learning medical imaging models into real-world clinical practice requires that they be calibrated. However, models that are well calibrated overall can still be poorly calibrated for a sub…
AttributeFairnessLesion ClassificationMedical Image Analysis+1Improved post-hoc probability calibration for out-of-domain MRI segmentation
Probability calibration for deep models is highly desirable in safety-critical applications such as medical imaging. It makes output probabilities of deep networks interpretable, by aligning prediction probability with t…
Image SegmentationMRI segmentationSegmentationSemantic Segmentation