Boosting Semi-supervised Image Segmentation with Global and Local Mutual Information Regularization
The scarcity of labeled data often impedes the application of deep learning to the segmentation of medical images. Semi-supervised learning seeks to overcome this limitation by exploiting unlabeled examples in the learning process. In this paper, we present a novel semi-supervised segmentation method that leverages mutual information (MI) on categorical distributions to achieve both global representation invariance and local smoothness. In this method, we maximize the MI for intermediate feature embeddings that are taken from both the encoder and decoder of a segmentation network. We first propose a global MI loss constraining the encoder to learn an image representation that is invariant to geometric transformations. Instead of resorting to computationally-expensive techniques for estimating the MI on continuous feature embeddings, we use projection heads to map them to a discrete cluster assignment where MI can be computed efficiently. Our method also includes a local MI loss to promote spatial consistency in the feature maps of the decoder and provide a smoother segmentation. Since mutual information does not require a strict ordering of clusters in two different assignments, we incorporate a final consistency regularization loss on the output which helps align the cluster labels throughout the network. We evaluate the method on four challenging publicly-available datasets for medical image segmentation. Experimental results show our method to outperform recently-proposed approaches for semi-supervised segmentation and provide an accuracy near to full supervision while training with very few annotated images.
Code (1)
Tasks
DecoderImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Diverse Teaching and Label Propagation for Generic Semi-Supervised Medical Image Segmentation
Both limited annotation and domain shift are significant challenges frequently encountered in medical image segmentation, leading to derivative scenarios like semi-supervised medical (SSMIS), semi-supervised medical doma…
Semi-supervised Medical Image SegmentationDomain GeneralizationData AugmentationDomain AdaptationSemi-supervised Semantic Segmentation via Boosting Uncertainty on Unlabeled Data
We bring a new perspective to semi-supervised semantic segmentation by providing an analysis on the labeled and unlabeled distributions in training datasets. We first figure out that the distribution gap between labeled …
SegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationMutual- and Self- Prototype Alignment for Semi-supervised Medical Image Segmentation
Semi-supervised learning methods have been explored in medical image segmentation tasks due to the scarcity of pixel-level annotation in the real scenario. Proto-type alignment based consistency constraint is an intuitio…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1Every Annotation Counts: Multi-label Deep Supervision for Medical Image Segmentation
Pixel-wise segmentation is one of the most data and annotation hungry tasks in our field. Providing representative and accurate annotations is often mission-critical especially for challenging medical applications. In th…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1Integrating semi-supervised label propagation and random forests for multi-atlas based hippocampus segmentation
A novel multi-atlas based image segmentation method is proposed by integrating a semi-supervised label propagation method and a supervised random forests method in a pattern recognition based label fusion framework. The …
HippocampusImage SegmentationregressionSegmentation+1