On Evaluating Adversarial Robustness of Volumetric Medical Segmentation Models
Volumetric medical segmentation models have achieved significant success on organ and tumor-based segmentation tasks in recent years. However, their vulnerability to adversarial attacks remains largely unexplored, raising serious concerns regarding the real-world deployment of tools employing such models in the healthcare sector. This underscores the importance of investigating the robustness of existing models. In this context, our work aims to empirically examine the adversarial robustness across current volumetric segmentation architectures, encompassing Convolutional, Transformer, and Mamba-based models. We extend this investigation across four volumetric segmentation datasets, evaluating robustness under both white box and black box adversarial attacks. Overall, we observe that while both pixel and frequency-based attacks perform reasonably well under \emph{white box} setting, the latter performs significantly better under transfer-based black box attacks. Across our experiments, we observe transformer-based models show higher robustness than convolution-based models with Mamba-based models being the most vulnerable. Additionally, we show that large-scale training of volumetric segmentation models improves the model's robustness against adversarial attacks. The code and robust models are available at https://github.com/HashmatShadab/Robustness-of-Volumetric-Medical-Segmentation-Models.
Code (1)
Tasks
Adversarial RobustnessMambaSegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Robust General Medical Image Segmentation
The reliability of Deep Learning systems depends on their accuracy but also on their robustness against adversarial perturbations to the input data. Several attacks and defenses have been proposed to improve the performa…
image-classificationImage ClassificationImage SegmentationMedical Image Segmentation+2Frequency Domain Adversarial Training for Robust Volumetric Medical Segmentation
It is imperative to ensure the robustness of deep learning models in critical applications such as, healthcare. While recent advances in deep learning have improved the performance of volumetric medical image segmentatio…
Adversarial AttackDeep LearningImage SegmentationMedical Image Segmentation+3V-NAS: Neural Architecture Search for Volumetric Medical Image Segmentation
Deep learning algorithms, in particular 2D and 3D fully convolutional neural networks (FCNs), have rapidly become the mainstream methodology for volumetric medical image segmentation. However, 2D convolutions cannot full…
GPUImage SegmentationMedical Image SegmentationNeural Architecture Search+3Evaluating and Enhancing Segmentation Model Robustness with Metamorphic Testing
Image segmentation is critical for applications such as medical imaging, augmented reality, and video surveillance. However, segmentation models often lack robustness, making them vulnerable to adversarial perturbations …
Image SegmentationSegmentationSemantic SegmentationDiff-UNet: A Diffusion Embedded Network for Volumetric Segmentation
In recent years, Denoising Diffusion Models have demonstrated remarkable success in generating semantically valuable pixel-wise representations for image generative modeling. In this study, we propose a novel end-to-end …
DenoisingSegmentation