An Evaluation of Self-Supervised Pre-Training for Skin-Lesion Analysis
Self-supervised pre-training appears as an advantageous alternative to supervised pre-trained for transfer learning. By synthesizing annotations on pretext tasks, self-supervision allows to pre-train models on large amounts of pseudo-labels before fine-tuning them on the target task. In this work, we assess self-supervision for the diagnosis of skin lesions, comparing three self-supervised pipelines to a challenging supervised baseline, on five test datasets comprising in- and out-of-distribution samples. Our results show that self-supervision is competitive both in improving accuracies and in reducing the variability of outcomes. Self-supervision proves particularly useful for low training data scenarios ($<1\,500$ and $<150$ samples), where its ability to stabilize the outcomes is essential to provide sound results.
Code (1)
Tasks
Transfer LearningSimilar Papers 제목 키워드 기반
Semi-supervised Skin Lesion Segmentation via Transformation Consistent Self-ensembling Model
Automatic skin lesion segmentation on dermoscopic images is an essential component in computer-aided diagnosis of melanoma. Recently, many fully supervised deep learning based methods have been proposed for automatic ski…
Lesion SegmentationSegmentationSkin Lesion SegmentationImproved skin lesion recognition by a Self-Supervised Curricular Deep Learning approach
State-of-the-art deep learning approaches for skin lesion recognition often require pretraining on larger and more varied datasets, to overcome the generalization limitations derived from the reduced size of the skin les…
Lesion ClassificationSelf-Supervised LearningSkin Lesion ClassificationAMLP:Adaptive Masking Lesion Patches for Self-supervised Medical Image Segmentation
Self-supervised masked image modeling has shown promising results on natural images. However, directly applying such methods to medical images remains challenging. This difficulty stems from the complexity and distinct c…
Image SegmentationMedical Image SegmentationRepresentation LearningSegmentation+1Enhancing the Generalization Capability of Skin Lesion Classification Models with Active Domain Adaptation Methods
We propose a method to improve the generalization ability of skin lesion classification models by combining self-supervised learning (SSL), unsupervised domain adaptation (UDA), and active domain adaptation (ADA). The ma…
Domain AdaptationLesion ClassificationSelf-Supervised LearningSkin Lesion Classification+1SuperCon: Supervised Contrastive Learning for Imbalanced Skin Lesion Classification
Convolutional neural networks (CNNs) have achieved great success in skin lesion classification. A balanced dataset is required to train a good model. However, due to the appearance of different skin lesions in practice, …
ClassificationContrastive LearningLesion ClassificationSkin Lesion Classification