Skin Lesion Classification Using CNNs with Patch-Based Attention and Diagnosis-Guided Loss Weighting
Objective: This work addresses two key problems of skin lesion classification. The first problem is the effective use of high-resolution images with pretrained standard architectures for image classification. The second problem is the high class imbalance encountered in real-world multi-class datasets. Methods: To use high-resolution images, we propose a novel patch-based attention architecture that provides global context between small, high-resolution patches. We modify three pretrained architectures and study the performance of patch-based attention. To counter class imbalance problems, we compare oversampling, balanced batch sampling, and class-specific loss weighting. Additionally, we propose a novel diagnosis-guided loss weighting method which takes the method used for ground-truth annotation into account. Results: Our patch-based attention mechanism outperforms previous methods and improves the mean sensitivity by 7%. Class balancing significantly improves the mean sensitivity and we show that our diagnosis-guided loss weighting method improves the mean sensitivity by 3% over normal loss balancing. Conclusion: The novel patch-based attention mechanism can be integrated into pretrained architectures and provides global context between local patches while outperforming other patch-based methods. Hence, pretrained architectures can be readily used with high-resolution images without downsampling. The new diagnosis-guided loss weighting method outperforms other methods and allows for effective training when facing class imbalance. Significance: The proposed methods improve automatic skin lesion classification. They can be extended to other clinical applications where high-resolution image data and class imbalance are relevant.
Code (1)
Tasks
General Classificationimage-classificationImage ClassificationLesion ClassificationSensitivitySkin Lesion ClassificationSimilar Papers 제목 키워드 기반
AMLP:Adaptive Masking Lesion Patches for Self-supervised Medical Image Segmentation
Self-supervised masked image modeling has shown promising results on natural images. However, directly applying such methods to medical images remains challenging. This difficulty stems from the complexity and distinct c…
Image SegmentationMedical Image SegmentationRepresentation LearningSegmentation+1Investigating and Exploiting Image Resolution for Transfer Learning-based Skin Lesion Classification
Skin cancer is among the most common cancer types. Dermoscopic image analysis improves the diagnostic accuracy for detection of malignant melanoma and other pigmented skin lesions when compared to unaided visual inspecti…
ClassificationDiagnosticGeneral ClassificationLesion Classification+2Skin Lesion Classification Using Hybrid Deep Neural Networks
Skin cancer is one of the major types of cancers with an increasing incidence over the past decades. Accurately diagnosing skin lesions to discriminate between benign and malignant skin lesions is crucial to ensure appro…
ClassificationGeneral ClassificationLesion ClassificationObject Detection+1SuperCon: Supervised Contrastive Learning for Imbalanced Skin Lesion Classification
Convolutional neural networks (CNNs) have achieved great success in skin lesion classification. A balanced dataset is required to train a good model. However, due to the appearance of different skin lesions in practice, …
ClassificationContrastive LearningLesion ClassificationSkin Lesion ClassificationFine-tuning of explainable CNNs for skin lesion classification based on dermatologists' feedback towards increasing trust
In this paper, we propose a CNN fine-tuning method which enables users to give simultaneous feedback on two outputs: the classification itself and the visual explanation for the classification. We present the effect of t…
ClassificationLesion ClassificationSkin Lesion Classification