Self-Ensembling Contrastive Learning for Semi-Supervised Medical Image Segmentation
Deep learning has demonstrated significant improvements in medical image segmentation using a sufficiently large amount of training data with manual labels. Acquiring well-representative labels requires expert knowledge and exhaustive labors. In this paper, we aim to boost the performance of semi-supervised learning for medical image segmentation with limited labels using a self-ensembling contrastive learning technique. To this end, we propose to train an encoder-decoder network at image-level with small amounts of labeled images, and more importantly, we learn latent representations directly at feature-level by imposing contrastive loss on unlabeled images. This method strengthens intra-class compactness and inter-class separability, so as to get a better pixel classifier. Moreover, we devise a student encoder for online learning and an exponential moving average version of it, called teacher encoder, to improve the performance iteratively in a self-ensembling manner. To construct contrastive samples with unlabeled images, two sampling strategies that exploit structure similarity across medical images and utilize pseudo-labels for construction, termed region-aware and anatomical-aware contrastive sampling, are investigated. We conduct extensive experiments on an MRI and a CT segmentation dataset and demonstrate that in a limited label setting, the proposed method achieves state-of-the-art performance. Moreover, the anatomical-aware strategy that prepares contrastive samples on-the-fly using pseudo-labels realizes better contrastive regularization on feature representations.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningDecoderImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationSemi-supervised Medical Image SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Transformation Consistent Self-ensembling Model for Semi-supervised Medical Image Segmentation
Deep convolutional neural networks have achieved remarkable progress on a variety of medical image computing tasks. A common problem when applying supervised deep learning methods to medical images is the lack of labeled…
Image SegmentationLesion SegmentationLiver SegmentationMedical Image Segmentation+6Semi-Supervised Learning by Disentangling and Self-Ensembling Over Stochastic Latent Space
The success of deep learning in medical imaging is mostly achieved at the cost of a large labeled data set. Semi-supervised learning (SSL) provides a promising solution by leveraging the structure of unlabeled data to im…
Data AugmentationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONRepresentation LearningSemi-Supervised Relational Contrastive Learning
Disease diagnosis from medical images via supervised learning is usually dependent on tedious, error-prone, and costly image labeling by medical experts. Alternatively, semi-supervised learning and self-supervised learni…
Contrastive LearningDiagnosticLesion ClassificationSelf-Supervised Learning+1Self-Loop Uncertainty: A Novel Pseudo-Label for Semi-Supervised Medical Image Segmentation
Witnessing the success of deep learning neural networks in natural image processing, an increasing number of studies have been proposed to develop deep-learning-based frameworks for medical image segmentation. However, s…
Image SegmentationMedical Image SegmentationPseudo LabelSegmentation+2Semi-supervised Medical Image Classification with Relation-driven Self-ensembling Model
Training deep neural networks usually requires a large amount of labeled data to obtain good performance. However, in medical image analysis, obtaining high-quality labels for the data is laborious and expensive, as accu…
ClassificationGeneral Classificationimage-classificationImage Classification+5