Robust Mutual Learning for Semi-supervised Semantic Segmentation
Recent semi-supervised learning (SSL) methods are commonly based on pseudo labeling. Since the SSL performance is greatly influenced by the quality of pseudo labels, mutual learning has been proposed to effectively suppress the noises in the pseudo supervision. In this work, we propose robust mutual learning that improves the prior approach in two aspects. First, the vanilla mutual learners suffer from the coupling issue that models may converge to learn homogeneous knowledge. We resolve this issue by introducing mean teachers to generate mutual supervisions so that there is no direct interaction between the two students. We also show that strong data augmentations, model noises and heterogeneous network architectures are essential to alleviate the model coupling. Second, we notice that mutual learning fails to leverage the network's own ability for pseudo label refinement. Therefore, we introduce self-rectification that leverages the internal knowledge and explicitly rectifies the pseudo labels before the mutual teaching. Such self-rectification and mutual teaching collaboratively improve the pseudo label accuracy throughout the learning. The proposed robust mutual learning demonstrates state-of-the-art performance on semantic segmentation in low-data regime.
Code (0)
등록된 구현이 없습니다.
Tasks
Pseudo LabelSemantic SegmentationSemi-Supervised Semantic SegmentationSimilar Papers 제목 키워드 기반
Semi-supervised Semantic Segmentation with Mutual Knowledge Distillation
Consistency regularization has been widely studied in recent semisupervised semantic segmentation methods, and promising performance has been achieved. In this work, we propose a new consistency regularization framework,…
DiversityKnowledge DistillationPseudo LabelSemantic Segmentation+1Mutual- and Self- Prototype Alignment for Semi-supervised Medical Image Segmentation
Semi-supervised learning methods have been explored in medical image segmentation tasks due to the scarcity of pixel-level annotation in the real scenario. Proto-type alignment based consistency constraint is an intuitio…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1Mutual Consistency Learning for Semi-supervised Medical Image Segmentation
In this paper, we propose a novel mutual consistency network (MC-Net+) to effectively exploit the unlabeled data for semi-supervised medical image segmentation. The MC-Net+ model is motivated by the observation that deep…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1Semi-supervised Left Atrium Segmentation with Mutual Consistency Training
Semi-supervised learning has attracted great attention in the field of machine learning, especially for medical image segmentation tasks, since it alleviates the heavy burden of collecting abundant densely annotated data…
Image SegmentationLeft Atrium SegmentationMedical Image SegmentationPseudo Label+2Polite Teacher: Semi-Supervised Instance Segmentation with Mutual Learning and Pseudo-Label Thresholding
We present Polite Teacher, a simple yet effective method for the task of semi-supervised instance segmentation. The proposed architecture relies on the Teacher-Student mutual learning framework. To filter out noisy pseud…
Instance SegmentationPseudo LabelSegmentationSemantic Segmentation+1