paper-with-me

홈 › Papers

Uncertainty estimation for out-of-distribution detection in computational histopathology

2022-10-18 · Lea Goetz

In computational histopathology algorithms now outperform humans on a range of tasks, but to date none are employed for automated diagnoses in the clinic. Before algorithms can be involved in such high-stakes decisions they need to "know when they don't know", i.e., they need to estimate their predictive uncertainty. This allows them to defer potentially erroneous predictions to a human pathologist, thus increasing their safety. Here, we evaluate the predictive performance and calibration of several uncertainty estimation methods on clinical histopathology data. We show that a distance-aware uncertainty estimation method outperforms commonly used approaches, such as Monte Carlo dropout and deep ensembles. However, we observe a drop in predictive performance and calibration on novel samples across all uncertainty estimation methods tested. We also investigate the use of uncertainty thresholding to reject out-of-distribution samples for selective prediction. We demonstrate the limitations of this approach and suggest areas for future research.

📄 PDF Abstract BibTeX arXiv:2210.09909

Code (0)

등록된 구현이 없습니다.

Tasks

Out-of-Distribution Detection

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Monte Carlo Dropout 설명 없음

Similar Papers 제목 키워드 기반

Uncertainty-Aware Image Classification In Biomedical Imaging Using Spectral-normalized Neural Gaussian Processes

2026-02-02 · Uma Meleti, Jeffrey J. Nirschl arxiv

Accurate histopathologic interpretation is key for clinical decision-making; however, current deep learning models for digital pathology are often overconfident and poorly calibrated in out-of-distribution (OOD) settings…

Image ClassificationGaussian Processes

Uncertainty Estimation of Transformer Predictions for Misclassification Detection

2022-05-01 · ACL 2022 5 · Artem Vazhentsev, Gleb Kuzmin, Artem Shelmanov, Akim Tsvigun 외

Uncertainty estimation (UE) of model predictions is a crucial step for a variety of tasks such as active learning, misclassification detection, adversarial attack detection, out-of-distribution detection, etc. Most of th…

Active LearningAdversarial AttackAdversarial Attack DetectionClassification+8

Uncertainty-Informed Deep Learning Models Enable High-Confidence Predictions for Digital Histopathology

2022-04-09 · James M Dolezal, Andrew Srisuwananukorn, Dmitry Karpeyev, Siddhi Ramesh 외

A model's ability to express its own predictive uncertainty is an essential attribute for maintaining clinical user confidence as computational biomarkers are deployed into real-world medical settings. In the domain of c…

AttributeUncertainty Quantificationwhole slide images

Inhibited Softmax for Uncertainty Estimation in Neural Networks

2018-10-03 · Marcin Możejko, Mateusz Susik, Rafał Karczewski

We present a new method for uncertainty estimation and out-of-distribution detection in neural networks with softmax output. We extend softmax layer with an additional constant input. The corresponding additional output …

Out-of-Distribution DetectionSentiment Analysis

Towards Confident Detection of Prostate Cancer using High Resolution Micro-ultrasound

2022-07-21 · Mahdi Gilany, Paul Wilson, Amoon Jamzad, Fahimeh Fooladgar 외

MOTIVATION: Detection of prostate cancer during transrectal ultrasound-guided biopsy is challenging. The highly heterogeneous appearance of cancer, presence of ultrasound artefacts, and noise all contribute to these diff…

Deep LearningVocal Bursts Intensity Prediction