paper-with-me

홈 › Papers

Unpaired cross-modality educed distillation (CMEDL) for medical image segmentation

2021-07-16 · Jue Jiang, Andreas Rimner, Joseph O. Deasy, Harini Veeraraghavan

Accurate and robust segmentation of lung cancers from CT, even those located close to mediastinum, is needed to more accurately plan and deliver radiotherapy and to measure treatment response. Therefore, we developed a new cross-modality educed distillation (CMEDL) approach, using unpaired CT and MRI scans, whereby an informative teacher MRI network guides a student CT network to extract features that signal the difference between foreground and background. Our contribution eliminates two requirements of distillation methods: (i) paired image sets by using an image to image (I2I) translation and (ii) pre-training of the teacher network with a large training set by using concurrent training of all networks. Our framework uses an end-to-end trained unpaired I2I translation, teacher, and student segmentation networks. Architectural flexibility of our framework is demonstrated using 3 segmentation and 2 I2I networks. Networks were trained with 377 CT and 82 T2w MRI from different sets of patients, with independent validation (N=209 tumors) and testing (N=609 tumors) datasets. Network design, methods to combine MRI with CT information, distillation learning under informative (MRI to CT), weak (CT to MRI) and equal teacher (MRI to MRI), and ablation tests were performed. Accuracy was measured using Dice similarity (DSC), surface Dice (sDSC), and Hausdorff distance at the 95$^{th}$ percentile (HD95). The CMEDL approach was significantly (p $<$ 0.001) more accurate (DSC of 0.77 vs. 0.73) than non-CMEDL methods with an informative teacher for CT lung tumor, with a weak teacher (DSC of 0.84 vs. 0.81) for MRI lung tumor, and with equal teacher (DSC of 0.90 vs. 0.88) for MRI multi-organ segmentation. CMEDL also reduced inter-rater lung tumor segmentation variabilities..

📄 PDF Abstract BibTeX arXiv:2107.07985

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationMedical Image SegmentationOrgan SegmentationSegmentationSemantic SegmentationTranslationTumor Segmentation

Similar Papers 제목 키워드 기반

Deep cross-modality (MR-CT) educed distillation learning for cone beam CT lung tumor segmentation

2021-02-17 · Jue Jiang, Sadegh Riyahi Alam, Ishita Chen, Perry Zhang 외

Despite the widespread availability of in-treatment room cone beam computed tomography (CBCT) imaging, due to the lack of reliable segmentation methods, CBCT is only used for gross set up corrections in lung radiotherapi…

Domain AdaptationSegmentationTumor Segmentation

Integrating cross-modality hallucinated MRI with CT to aid mediastinal lung tumor segmentation

2019-09-10 · Jue Jiang, Jason Hu, Neelam Tyagi, Andreas Rimner 외

Lung tumors, especially those located close to or surrounded by soft tissues like the mediastinum, are difficult to segment due to the low soft tissue contrast on computed tomography images. Magnetic resonance images con…

SegmentationTumor Segmentation

UnDA: Unpaired Domain Alignment for Cross-Modal Knowledge Transfer in Medical Imaging

2026-07-23 · Rafsan Jany, Shadab Tanjeed Ahmad, Ahsan Bulbul, Tahsinul Islam 외 arxiv

Multimodal based approaches often outperform single modality approaches in downstream tasks as the different modalities provide complementary information, yet acquiring paired clinical data remains a significant challeng…

Knowledge Distillation

Unpaired Multi-modal Segmentation via Knowledge Distillation

2020-01-06 · Qi Dou, Quande Liu, Pheng Ann Heng, Ben Glocker

Multi-modal learning is typically performed with network architectures containing modality-specific layers and shared layers, utilizing co-registered images of different modalities. We propose a novel learning scheme for…

Image SegmentationKnowledge DistillationOrgan SegmentationSegmentation+1

EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillation

2021-11-24 · CVPR 2021 1 · Lin Wang, Yujeong Chae, Sung-Hoon Yoon, Tae-Kyun Kim 외

Event cameras sense per-pixel intensity changes and produce asynchronous event streams with high dynamic range and less motion blur, showing advantages over conventional cameras. A hurdle of training event-based models i…

Event-based Object SegmentationKnowledge DistillationObject RecognitionSemantic Segmentation