Influence of Classification Task and Distribution Shift Type on OOD Detection in Fetal Ultrasound
Reliable out-of-distribution (OOD) detection is important for safe deployment of deep learning models in fetal ultrasound amidst heterogeneous image characteristics and clinical settings. OOD detection relies on estimating a classification model's uncertainty, which should increase for OOD samples. While existing research has largely focused on uncertainty quantification methods, this work investigates the impact of the classification task itself. Through experiments with eight uncertainty quantification methods across four classification tasks, we demonstrate that OOD detection performance significantly varies with the task, and that the best task depends on the defined ID-OOD criteria; specifically, whether the OOD sample is due to: i) an image characteristic shift or ii) an anatomical feature shift. Furthermore, we reveal that superior OOD detection does not guarantee optimal abstained prediction, underscoring the necessity to align task selection and uncertainty strategies with the specific downstream application in medical image analysis.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Surgical Fine-Tuning Improves Adaptation to Distribution Shifts
A common approach to transfer learning under distribution shift is to fine-tune the last few layers of a pre-trained model, preserving learned features while also adapting to the new task. This paper shows that in such s…
Transfer LearningIPNET:Influential Prototypical Networks for Few Shot Learning
Prototypical network (PN) is a simple yet effective few shot learning strategy. It is a metric-based meta-learning technique where classification is performed by computing Euclidean distances to prototypical representati…
Few-Shot LearningMeta-LearningTLXML: Task-Level Explanation of Meta-Learning via Influence Functions
The scheme of adaptation via meta-learning is seen as an ingredient for solving the problem of data shortage or distribution shift in real-world applications, but it also brings the new risk of inappropriate updates of t…
image-classificationImage ClassificationMeta-LearningPrediction Accuracy & Reliability: Classification and Object Localization under Distribution Shift
Natural distribution shift causes a deterioration in the perception performance of convolutional neural networks (CNNs). This comprehensive analysis for real-world traffic data addresses: 1) investigating the effect of n…
Autonomous DrivingBenchmarkingObject LocalizationUncertainty QuantificationSharpness & Shift-Aware Self-Supervised Learning
Self-supervised learning aims to extract meaningful features from unlabeled data for further downstream tasks. In this paper, we consider classification as a downstream task in phase 2 and develop rigorous theories to re…
ClassificationContrastive LearningData AugmentationSelf-Supervised Learning