Performance Estimation for Supervised Medical Image Segmentation Models on Unlabeled Data Using UniverSeg
The performance of medical image segmentation models is usually evaluated using metrics like the Dice score and Hausdorff distance, which compare predicted masks to ground truth annotations. However, when applying the model to unseen data, such as in clinical settings, it is often impractical to annotate all the data, making the model's performance uncertain. To address this challenge, we propose the Segmentation Performance Evaluator (SPE), a framework for estimating segmentation models' performance on unlabeled data. This framework is adaptable to various evaluation metrics and model architectures. Experiments on six publicly available datasets across six evaluation metrics including pixel-based metrics such as Dice score and distance-based metrics like HD95, demonstrated the versatility and effectiveness of our approach, achieving a high correlation (0.956$\pm$0.046) and low MAE (0.025$\pm$0.019) compare with real Dice score on the independent test set. These results highlight its ability to reliably estimate model performance without requiring annotations. The SPE framework integrates seamlessly into any model training process without adding training overhead, enabling performance estimation and facilitating the real-world application of medical image segmentation algorithms. The source code is publicly available
Code (0)
등록된 구현이 없습니다.
Tasks
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Inconsistency-aware Uncertainty Estimation for Semi-supervised Medical Image Segmentation
In semi-supervised medical image segmentation, most previous works draw on the common assumption that higher entropy means higher uncertainty. In this paper, we investigate a novel method of estimating uncertainty. We ob…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1Uncertainty-aware multi-view co-training for semi-supervised medical image segmentation and domain adaptation
Although having achieved great success in medical image segmentation, deep learning-based approaches usually require large amounts of well-annotated data, which can be extremely expensive in the field of medical image an…
Domain AdaptationImage SegmentationMedical Image AnalysisMedical Image Segmentation+7EVIL: Evidential Inference Learning for Trustworthy Semi-supervised Medical Image Segmentation
Recently, uncertainty-aware methods have attracted increasing attention in semi-supervised medical image segmentation. However, current methods usually suffer from the drawback that it is difficult to balance the computa…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+2RCPS: Rectified Contrastive Pseudo Supervision for Semi-Supervised Medical Image Segmentation
Medical image segmentation methods are generally designed as fully-supervised to guarantee model performance, which require a significant amount of expert annotated samples that are high-cost and laborious. Semi-supervis…
Contrastive LearningImage SegmentationMedical Image SegmentationSegmentation+2On the Effect of Inter-observer Variability for a Reliable Estimation of Uncertainty of Medical Image Segmentation
Uncertainty estimation methods are expected to improve the understanding and quality of computer-assisted methods used in medical applications (e.g., neurosurgical interventions, radiotherapy planning), where automated m…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation