paper-with-me

홈 › Papers

Modality-Agnostic Learning for Medical Image Segmentation Using Multi-modality Self-distillation

2023-06-06 · Qisheng He, Nicholas Summerfield, Ming Dong, Carri Glide-Hurst

Medical image segmentation of tumors and organs at risk is a time-consuming yet critical process in the clinic that utilizes multi-modality imaging (e.g, different acquisitions, data types, and sequences) to increase segmentation precision. In this paper, we propose a novel framework, Modality-Agnostic learning through Multi-modality Self-dist-illation (MAG-MS), to investigate the impact of input modalities on medical image segmentation. MAG-MS distills knowledge from the fusion of multiple modalities and applies it to enhance representation learning for individual modalities. Thus, it provides a versatile and efficient approach to handle limited modalities during testing. Our extensive experiments on benchmark datasets demonstrate the high efficiency of MAG-MS and its superior segmentation performance than current state-of-the-art methods. Furthermore, using MAG-MS, we provide valuable insight and guidance on selecting input modalities for medical image segmentation tasks.

📄 PDF Abstract BibTeX arXiv:2306.03730

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationMedical Image SegmentationRepresentation LearningSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Modality-agnostic Domain Generalizable Medical Image Segmentation by Multi-Frequency in Multi-Scale Attention

2024-05-10 · CVPR 2024 1 · Ju-Hyeon Nam, Nur Suriza Syazwany, Su Jung Kim, Sang-Chul Lee

Generalizability in deep neural networks plays a pivotal role in medical image segmentation. However, deep learning-based medical image analyses tend to overlook the importance of frequency variance, which is critical el…

Image SegmentationMedical Image SegmentationMulti-Task LearningSegmentation+1

MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentation

2023-09-16 · Cheng Chen, Juzheng Miao, Dufan Wu, Zhiling Yan 외

The Segment Anything Model (SAM), a foundation model for general image segmentation, has demonstrated impressive zero-shot performance across numerous natural image segmentation tasks. However, SAM's performance signific…

Image SegmentationMedical Image SegmentationOrgan Segmentationparameter-efficient fine-tuning+4

A Fully-Automatic Framework for Parkinson's Disease Diagnosis by Multi-Modality Images

2019-02-26 · Jiahang Xu, Fangyang Jiao, Yechong Huang, Xinzhe Luo 외

Background: Parkinson's disease (PD) is a prevalent long-term neurodegenerative disease. Though the diagnostic criteria of PD are relatively well defined, the current medical imaging diagnostic procedures are expertise-d…

DiagnosticGeneral ClassificationSegmentation

Enhancing Modality-Agnostic Representations via Meta-Learning for Brain Tumor Segmentation

2023-02-08 · ICCV 2023 1 · Aishik Konwer, Xiaoling Hu, Joseph Bae, Xuan Xu 외

In medical vision, different imaging modalities provide complementary information. However, in practice, not all modalities may be available during inference or even training. Previous approaches, e.g., knowledge distill…

Brain Tumor SegmentationImage GenerationKnowledge DistillationMeta-Learning+2

When Fusion Fails: Corruption-Aware Rebalanced Fusion for Multi-Modal Medical Image Segmentation

2026-09-09 · Yuchen Pei, Xiaoyu Hu, Yixiong Zou, Dingwen Hu 외 arxiv

Multi-modal medical image segmentation leverages complementary diagnostic information, yet fusion can underperform single-modality baselines when spatially aligned inputs differ in quality. Here, "corruption" primarily d…

Medical Image Segmentation