paper-with-me

홈 › Papers

Efficient Knowledge Distillation of SAM for Medical Image Segmentation

2025-01-28 · Kunal Dasharath Patil, Gowthamaan Palani, Ganapathy Krishnamurthi

The Segment Anything Model (SAM) has set a new standard in interactive image segmentation, offering robust performance across various tasks. However, its significant computational requirements limit its deployment in real-time or resource-constrained environments. To address these challenges, we propose a novel knowledge distillation approach, KD SAM, which incorporates both encoder and decoder optimization through a combination of Mean Squared Error (MSE) and Perceptual Loss. This dual-loss framework captures structural and semantic features, enabling the student model to maintain high segmentation accuracy while reducing computational complexity. Based on the model evaluation on datasets, including Kvasir-SEG, ISIC 2017, Fetal Head Ultrasound, and Breast Ultrasound, we demonstrate that KD SAM achieves comparable or superior performance to the baseline models, with significantly fewer parameters. KD SAM effectively balances segmentation accuracy and computational efficiency, making it well-suited for real-time medical image segmentation applications in resource-constrained environments.

📄 PDF Abstract BibTeX arXiv:2501.16740

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyDecoderImage SegmentationKnowledge DistillationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…
SAM 설명 없음

Similar Papers 제목 키워드 기반

Learnable Prompting SAM-induced Knowledge Distillation for Semi-supervised Medical Image Segmentation

2024-12-18 · Kaiwen Huang, Tao Zhou, Huazhu Fu, Yizhe Zhang 외

The limited availability of labeled data has driven advancements in semi-supervised learning for medical image segmentation. Modern large-scale models tailored for general segmentation, such as the Segment Anything Model…

Image SegmentationKnowledge DistillationMedical Image SegmentationSegmentation+2

Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation

2025-03-10 · Pengchen Liang, Haishan Huang, Bin Pu, Jianguo Chen 외

Large-scale pre-trained models, such as Vision Foundation Models (VFMs), have demonstrated impressive performance across various downstream tasks by transferring generalized knowledge, especially when target data is limi…

Image SegmentationKnowledge DistillationMedical Image SegmentationSegmentation+1

Graph Relation Distillation for Efficient Biomedical Instance Segmentation

2024-01-12 · Xiaoyu Liu, Yueyi Zhang, Zhiwei Xiong, Wei Huang 외

Instance-aware embeddings predicted by deep neural networks have revolutionized biomedical instance segmentation, but its resource requirements are substantial. Knowledge distillation offers a solution by transferring di…

Instance SegmentationKnowledge DistillationRelationSemantic Segmentation

Shape-intensity knowledge distillation for robust medical image segmentation

2024-09-26 · Wenhui Dong, Bo Du, Yongchao Xu

Many medical image segmentation methods have achieved impressive results. Yet, most existing methods do not take into account the shape-intensity prior information. This may lead to implausible segmentation results, in p…

Image SegmentationKnowledge DistillationMedical Image SegmentationSegmentation+1

DSFedMed: Dual-Scale Federated Medical Image Segmentation via Mutual Distillation Between Foundation and Lightweight Models

2026-01-22 · Hanwen Zhang, Qiaojin Shen, Yuxi Liu, Yuesheng Zhu 외 arxiv

Foundation Models (FMs) have demonstrated strong generalization across diverse vision tasks. However, their deployment in federated settings is hindered by high computational demands, substantial communication overhead, …

Medical Image SegmentationKnowledge DistillationGeneral Knowledge