Improved skin lesion recognition by a Self-Supervised Curricular Deep Learning approach
State-of-the-art deep learning approaches for skin lesion recognition often require pretraining on larger and more varied datasets, to overcome the generalization limitations derived from the reduced size of the skin lesion imaging datasets. ImageNet is often used as the pretraining dataset, but its transferring potential is hindered by the domain gap between the source dataset and the target dermatoscopic scenario. In this work, we introduce a novel pretraining approach that sequentially trains a series of Self-Supervised Learning pretext tasks and only requires the unlabeled skin lesion imaging data. We present a simple methodology to establish an ordering that defines a pretext task curriculum. For the multi-class skin lesion classification problem, and ISIC-2019 dataset, we provide experimental evidence showing that: i) a model pretrained by a curriculum of pretext tasks outperforms models pretrained by individual pretext tasks, and ii) a model pretrained by the optimal pretext task curriculum outperforms a model pretrained on ImageNet. We demonstrate that this performance gain is related to the fact that the curriculum of pretext tasks better focuses the attention of the final model on the skin lesion. Beyond performance improvement, this strategy allows for a large reduction in the training time with respect to ImageNet pretraining, which is especially advantageous for network architectures tailored for a specific problem.
Code (0)
등록된 구현이 없습니다.
Tasks
Lesion ClassificationSelf-Supervised LearningSkin Lesion ClassificationSimilar Papers 제목 키워드 기반
Skin lesion classification with ensemble of squeeze-and-excitation networks and semi-supervised learning
In this report, we introduce the outline of our system in Task 3: Disease Classification of ISIC 2018: Skin Lesion Analysis Towards Melanoma Detection. We fine-tuned multiple pre-trained neural network models based on Sq…
ClassificationData AugmentationGeneral ClassificationLesion Classification+1AMLP:Adaptive Masking Lesion Patches for Self-supervised Medical Image Segmentation
Self-supervised masked image modeling has shown promising results on natural images. However, directly applying such methods to medical images remains challenging. This difficulty stems from the complexity and distinct c…
Image SegmentationMedical Image SegmentationRepresentation LearningSegmentation+1Semi-supervised Skin Lesion Segmentation via Transformation Consistent Self-ensembling Model
Automatic skin lesion segmentation on dermoscopic images is an essential component in computer-aided diagnosis of melanoma. Recently, many fully supervised deep learning based methods have been proposed for automatic ski…
Lesion SegmentationSegmentationSkin Lesion SegmentationEnhancing the Generalization Capability of Skin Lesion Classification Models with Active Domain Adaptation Methods
We propose a method to improve the generalization ability of skin lesion classification models by combining self-supervised learning (SSL), unsupervised domain adaptation (UDA), and active domain adaptation (ADA). The ma…
Domain AdaptationLesion ClassificationSelf-Supervised LearningSkin Lesion Classification+1An Evaluation of Self-Supervised Pre-Training for Skin-Lesion Analysis
Self-supervised pre-training appears as an advantageous alternative to supervised pre-trained for transfer learning. By synthesizing annotations on pretext tasks, self-supervision allows to pre-train models on large amou…
Transfer Learning