paper-with-me

홈 › Papers

Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentation

2021-12-17 · Krishna Chaitanya, Ertunc Erdil, Neerav Karani, Ender Konukoglu

Supervised deep learning-based methods yield accurate results for medical image segmentation. However, they require large labeled datasets for this, and obtaining them is a laborious task that requires clinical expertise. Semi/self-supervised learning-based approaches address this limitation by exploiting unlabeled data along with limited annotated data. Recent self-supervised learning methods use contrastive loss to learn good global level representations from unlabeled images and achieve high performance in classification tasks on popular natural image datasets like ImageNet. In pixel-level prediction tasks such as segmentation, it is crucial to also learn good local level representations along with global representations to achieve better accuracy. However, the impact of the existing local contrastive loss-based methods remains limited for learning good local representations because similar and dissimilar local regions are defined based on random augmentations and spatial proximity; not based on the semantic label of local regions due to lack of large-scale expert annotations in the semi/self-supervised setting. In this paper, we propose a local contrastive loss to learn good pixel level features useful for segmentation by exploiting semantic label information obtained from pseudo-labels of unlabeled images alongside limited annotated images. In particular, we define the proposed loss to encourage similar representations for the pixels that have the same pseudo-label/ label while being dissimilar to the representation of pixels with different pseudo-label/label in the dataset. We perform pseudo-label based self-training and train the network by jointly optimizing the proposed contrastive loss on both labeled and unlabeled sets and segmentation loss on only the limited labeled set. We evaluated on three public cardiac and prostate datasets, and obtain high segmentation performance.

📄 PDF Abstract BibTeX arXiv:2112.09645

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationMedical Image SegmentationPseudo LabelSegmentationSelf-Supervised LearningSemantic SegmentationSemi-supervised Medical Image Segmentation

Similar Papers 제목 키워드 기반

Self Adaptive Threshold Pseudo-labeling and Unreliable Sample Contrastive Loss for Semi-supervised Image Classification

2024-07-04 · Xuerong Zhang, Li Huang, Jing Lv, Ming Yang

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in image classification: (1) E…

image-classificationImage ClassificationSemi-Supervised Image Classification

Semi-Supervised Sound Event Detection with Conditional Mixup and Embedding-Level Contrastive Loss

2026-06-29 · Nian Shao, Xian Li, Xiaofei Li arxiv

Sound event detection (SED) is a core module for acoustic environmental analysis, yet its performance is often limited by scarce labeled data. Recent systems leverage large pretrained audio foundation models, but effecti…

Sound Event DetectionContrastive Learning

Unsupervised Foggy Scene Understanding via Self Spatial-Temporal Label Diffusion

2022-06-10 · Liang Liao, WenYi Chen, Jing Xiao, Zheng Wang 외

Understanding foggy image sequence in the driving scenes is critical for autonomous driving, but it remains a challenging task due to the difficulty in collecting and annotating real-world images of adverse weather. Rece…

Autonomous DrivingDomain AdaptationPseudo LabelScene Understanding+3

Improving Self-training for Cross-lingual Named Entity Recognition with Contrastive and Prototype Learning

2023-05-23 · Ran Zhou, Xin Li, Lidong Bing, Erik Cambria 외

In cross-lingual named entity recognition (NER), self-training is commonly used to bridge the linguistic gap by training on pseudo-labeled target-language data. However, due to sub-optimal performance on target languages…

Cross-Lingual NERnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+3

CAST: Contrastive Adaptation and Distillation for Semi-Supervised Instance Segmentation

2025-05-28 · Pardis Taghavi, Tian Liu, Renjie Li, Reza Langari 외

Instance segmentation demands costly per-pixel annotations and large models. We introduce CAST, a semi-supervised knowledge distillation (SSKD) framework that compresses pretrained vision foundation models (VFM) into com…

Domain AdaptationInstance SegmentationKnowledge DistillationPseudo Label+2