Efficient Knowledge Distillation of SAM for Medical Image Segmentation
The Segment Anything Model (SAM) has set a new standard in interactive image segmentation, offering robust performance across various tasks. However, its significant computational requirements limit its deployment in real-time or resource-constrained environments. To address these challenges, we propose a novel knowledge distillation approach, KD SAM, which incorporates both encoder and decoder optimization through a combination of Mean Squared Error (MSE) and Perceptual Loss. This dual-loss framework captures structural and semantic features, enabling the student model to maintain high segmentation accuracy while reducing computational complexity. Based on the model evaluation on datasets, including Kvasir-SEG, ISIC 2017, Fetal Head Ultrasound, and Breast Ultrasound, we demonstrate that KD SAM achieves comparable or superior performance to the baseline models, with significantly fewer parameters. KD SAM effectively balances segmentation accuracy and computational efficiency, making it well-suited for real-time medical image segmentation applications in resource-constrained environments.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyDecoderImage SegmentationKnowledge DistillationMedical Image SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learnable Prompting SAM-induced Knowledge Distillation for Semi-supervised Medical Image Segmentation
The limited availability of labeled data has driven advancements in semi-supervised learning for medical image segmentation. Modern large-scale models tailored for general segmentation, such as the Segment Anything Model…
Image SegmentationKnowledge DistillationMedical Image SegmentationSegmentation+2Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation
Large-scale pre-trained models, such as Vision Foundation Models (VFMs), have demonstrated impressive performance across various downstream tasks by transferring generalized knowledge, especially when target data is limi…
Image SegmentationKnowledge DistillationMedical Image SegmentationSegmentation+1Graph Relation Distillation for Efficient Biomedical Instance Segmentation
Instance-aware embeddings predicted by deep neural networks have revolutionized biomedical instance segmentation, but its resource requirements are substantial. Knowledge distillation offers a solution by transferring di…
Instance SegmentationKnowledge DistillationRelationSemantic SegmentationShape-intensity knowledge distillation for robust medical image segmentation
Many medical image segmentation methods have achieved impressive results. Yet, most existing methods do not take into account the shape-intensity prior information. This may lead to implausible segmentation results, in p…
Image SegmentationKnowledge DistillationMedical Image SegmentationSegmentation+1DSFedMed: Dual-Scale Federated Medical Image Segmentation via Mutual Distillation Between Foundation and Lightweight Models
Foundation Models (FMs) have demonstrated strong generalization across diverse vision tasks. However, their deployment in federated settings is hindered by high computational demands, substantial communication overhead, …
Medical Image SegmentationKnowledge DistillationGeneral Knowledge