paper-with-me

홈 › Papers

Shape-intensity knowledge distillation for robust medical image segmentation

2024-09-26 · Wenhui Dong, Bo Du, Yongchao Xu

Many medical image segmentation methods have achieved impressive results. Yet, most existing methods do not take into account the shape-intensity prior information. This may lead to implausible segmentation results, in particular for images of unseen datasets. In this paper, we propose a novel approach to incorporate joint shape-intensity prior information into the segmentation network. Specifically, we first train a segmentation network (regarded as the teacher network) on class-wise averaged training images to extract valuable shape-intensity information, which is then transferred to a student segmentation network with the same network architecture as the teacher via knowledge distillation. In this way, the student network regarded as the final segmentation model can effectively integrate the shape-intensity prior information, yielding more accurate segmentation results. Despite its simplicity, experiments on five medical image segmentation tasks of different modalities demonstrate that the proposed Shape-Intensity Knowledge Distillation (SIKD) consistently improves several baseline models (including recent MaxStyle and SAMed) under intra-dataset evaluation, and significantly improves the cross-dataset generalization ability. The code is available at https://github.com/whdong-whu/SIKD.

📄 PDF Abstract BibTeX arXiv:2409.17503

Code (1)

whdong-whu/sikd 공식 구현 pytorch

Tasks

Image SegmentationKnowledge DistillationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Volumetric medical image segmentation through dual self-distillation in U-shaped networks

2023-06-05 · Soumyanil Banerjee, Nicholas Summerfield, Ming Dong, Carri Glide-Hurst

U-shaped networks and its variants have demonstrated exceptional results for medical image segmentation. In this paper, we propose a novel dual self-distillation (DSD) framework in U-shaped networks for volumetric medica…

Brain Tumor SegmentationDecoderHippocampusImage Segmentation+5

Digital Staining with Knowledge Distillation: A Unified Framework for Unpaired and Paired-But-Misaligned Data

2025-04-14 · Ziwang Xu, Lanqing Guo, Satoshi Tsutsui, Shuyan Zhang 외

Staining is essential in cell imaging and medical diagnostics but poses significant challenges, including high cost, time consumption, labor intensity, and irreversible tissue alterations. Recent advances in deep learnin…

ColorizationKnowledge Distillation

Class Incremental Medical Image Segmentation via Prototype-Guided Calibration and Dual-Aligned Distillation

2025-11-11 · Shengqian Zhu, Chengrong Yu, Qiang Wang, Ying Song 외 arxiv

Class incremental medical image segmentation (CIMIS) aims to preserve knowledge of previously learned classes while learning new ones without relying on old-class labels. However, existing methods 1) either adopt one-siz…

Medical Image Segmentation

Dynamic multi feature-class Gaussian process models

2021-12-08 · Jean-Rassaire Fouefack, Bhushan Borotikar, Marcel Lüthi, Tania S. Douglas 외

In model-based medical image analysis, three features of interest are the shape of structures of interest, their relative pose, and image intensity profiles representative of some physical property. Often, these are mode…

Decision MakingManagementMedical Image Analysis

IMKD: Intensity-Aware Multi-Level Knowledge Distillation for Camera-Radar Fusion

2025-12-17 · Shashank Mishra, Karan Patil, Didier Stricker, Jason Rambach arxiv

High-performance Radar-Camera 3D object detection can be achieved by leveraging knowledge distillation without using LiDAR at inference time. However, existing distillation methods typically transfer modality-specific fe…

Knowledge Distillation3D Object Detection