Alternate Diverse Teaching for Semi-supervised Medical Image Segmentation
Semi-supervised medical image segmentation studies have shown promise in training models with limited labeled data. However, current dominant teacher-student based approaches can suffer from the confirmation bias. To address this challenge, we propose AD-MT, an alternate diverse teaching approach in a teacher-student framework. It involves a single student model and two non-trainable teacher models that are momentum-updated periodically and randomly in an alternate fashion. To mitigate the confirmation bias from the diverse supervision, the core of AD-MT lies in two proposed modules: the Random Periodic Alternate (RPA) Updating Module and the Conflict-Combating Module (CCM). The RPA schedules the alternating diverse updating process with complementary data batches, distinct data augmentation, and random switching periods to encourage diverse reasoning from different teaching perspectives. The CCM employs an entropy-based ensembling strategy to encourage the model to learn from both the consistent and conflicting predictions between the teachers. Experimental results demonstrate the effectiveness and superiority of our AD-MT on the 2D and 3D medical segmentation benchmarks across various semi-supervised settings.
Code (1)
Tasks
Data AugmentationImage SegmentationMedical Image SegmentationSemantic SegmentationSemi-supervised Medical Image SegmentationSimilar Papers 제목 키워드 기반
Diverse Teaching and Label Propagation for Generic Semi-Supervised Medical Image Segmentation
Both limited annotation and domain shift are significant challenges frequently encountered in medical image segmentation, leading to derivative scenarios like semi-supervised medical (SSMIS), semi-supervised medical doma…
Semi-supervised Medical Image SegmentationDomain GeneralizationData AugmentationDomain AdaptationSemi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformer
Recently, deep learning with Convolutional Neural Networks (CNNs) and Transformers has shown encouraging results in fully supervised medical image segmentation. However, it is still challenging for them to achieve good p…
Image SegmentationMedical Image SegmentationPseudo LabelSegmentation+2Learning Semi-Supervised Medical Image Segmentation from Spatial Registration
Semi-supervised medical image segmentation has shown promise in training models with limited labeled data and abundant unlabeled data. However, state-of-the-art methods ignore a potentially valuable source of unsupervise…
Contrastive LearningImage SegmentationMedical Image SegmentationSegmentation+2Knowledge Distillation from Cross Teaching Teachers for Efficient Semi-Supervised Abdominal Organ Segmentation in CT
For more clinical applications of deep learning models for medical image segmentation, high demands on labeled data and computational resources must be addressed. This study proposes a coarse-to-fine framework with two t…
Image SegmentationKnowledge DistillationMedical Image SegmentationOrgan Segmentation+2ATSO: Asynchronous Teacher-Student Optimization for Semi-Supervised Medical Image Segmentation
In medical image analysis, semi-supervised learning is an effective method to extract knowledge from a small amount of labeled data and a large amount of unlabeled data. This paper focuses on a popular pipeline known as …
Autonomous DrivingImage SegmentationMedical Image AnalysisMedical Image Segmentation+4