Towards Robust General Medical Image Segmentation
The reliability of Deep Learning systems depends on their accuracy but also on their robustness against adversarial perturbations to the input data. Several attacks and defenses have been proposed to improve the performance of Deep Neural Networks under the presence of adversarial noise in the natural image domain. However, robustness in computer-aided diagnosis for volumetric data has only been explored for specific tasks and with limited attacks. We propose a new framework to assess the robustness of general medical image segmentation systems. Our contributions are two-fold: (i) we propose a new benchmark to evaluate robustness in the context of the Medical Segmentation Decathlon (MSD) by extending the recent AutoAttack natural image classification framework to the domain of volumetric data segmentation, and (ii) we present a novel lattice architecture for RObust Generic medical image segmentation (ROG). Our results show that ROG is capable of generalizing across different tasks of the MSD and largely surpasses the state-of-the-art under sophisticated adversarial attacks.
Code (2)
Tasks
image-classificationImage ClassificationImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
GMISeg: General Medical Image Segmentation without Re-Training
Deep learning models have become the dominant method for medical image segmentation. However, they often struggle to be generalisable to unknown tasks involving new anatomical structures, labels, or shapes. In these case…
DecoderEnsemble Learningfeature selectionImage Segmentation+3Input Augmentation with SAM: Boosting Medical Image Segmentation with Segmentation Foundation Model
The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentat…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationGeneralist Vision Foundation Models for Medical Imaging: A Case Study of Segment Anything Model on Zero-Shot Medical Segmentation
In this paper, we examine the recent Segment Anything Model (SAM) on medical images, and report both quantitative and qualitative zero-shot segmentation results on nine medical image segmentation benchmarks, covering var…
Computed Tomography (CT)Image SegmentationMedical Image SegmentationSegmentation+2Generalizable Medical Image Segmentation via Random Amplitude Mixup and Domain-Specific Image Restoration
For medical image analysis, segmentation models trained on one or several domains lack generalization ability to unseen domains due to discrepancies between different data acquisition policies. We argue that the degenera…
Image RestorationImage SegmentationMedical Image AnalysisMedical Image Segmentation+2SQA-SAM: Segmentation Quality Assessment for Medical Images Utilizing the Segment Anything Model
Segmentation quality assessment (SQA) plays a critical role in the deployment of a medical image based AI system. Users need to be informed/alerted whenever an AI system generates unreliable/incorrect predictions. With t…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation