On the calibration of neural networks for histological slide-level classification
Deep Neural Networks have shown promising classification performance when predicting certain biomarkers from Whole Slide Images in digital pathology. However, the calibration of the networks' output probabilities is often not evaluated. Communicating uncertainty by providing reliable confidence scores is of high relevance in the medical context. In this work, we compare three neural network architectures that combine feature representations on patch-level to a slide-level prediction with respect to their classification performance and evaluate their calibration. As slide-level classification task, we choose the prediction of Microsatellite Instability from Colorectal Cancer tissue sections. We observe that Transformers lead to good results in terms of classification performance and calibration. When evaluating the classification performance on a separate dataset, we observe that Transformers generalize best. The investigation of reliability diagrams provides additional insights to the Expected Calibration Error metric and we observe that especially Transformers push the output probabilities to extreme values, which results in overconfident predictions.
Code (1)
Tasks
Classificationwhole slide imagesSimilar Papers 제목 키워드 기반
Plexus Convolutional Neural Network (PlexusNet): A novel neural network architecture for histologic image analysis
Different convolutional neural network (CNN) models have been tested for their application in histological image analyses. However, these models are prone to overfitting due to their large parameter capacity, requiring m…
General ClassificationAttention-based Multiple Instance Learning with Mixed Supervision on the Camelyon16 Dataset
Since the standardization of Whole Slide Images (WSIs) digitization, the use of deep learning methods for the analysis of histological images has shown much potential. However, the sheer size of WSIs is a real challenge,…
Multiple Instance Learningwhole slide imagesMAPLE: Multi-scale Attribute-enhanced Prompt Learning for Few-shot Whole Slide Image Classification
Prompt learning has emerged as a promising paradigm for adapting pre-trained vision-language models (VLMs) to few-shot whole slide image (WSI) classification by aligning visual features with textual representations, ther…
Image ClassificationGraph LearningUnsupervised Artifact Detection for Whole Slide Images of Prostate Biopsies
High-quality image digitisation of histological slides is essential for digital pathology to facilitate diagnosis and to develop reliable computer-aided assistance systems. Currently, image quality control (QC) to identi…
Artifact DetectionOne-Class Classificationwhole slide imagesA Robust and Effective Approach Towards Accurate Metastasis Detection and pN-stage Classification in Breast Cancer
Predicting TNM stage is the major determinant of breast cancer prognosis and treatment. The essential part of TNM stage classification is whether the cancer has metastasized to the regional lymph nodes (N-stage). Patholo…
DiagnosticGeneral ClassificationPrognosis