Fine-tuning of explainable CNNs for skin lesion classification based on dermatologists' feedback towards increasing trust
In this paper, we propose a CNN fine-tuning method which enables users to give simultaneous feedback on two outputs: the classification itself and the visual explanation for the classification. We present the effect of this feedback strategy in a skin lesion classification task and measure how CNNs react to the two types of user feedback. To implement this approach, we propose a novel CNN architecture that integrates the Grad-CAM technique for explaining the model's decision in the training loop. Using simulated user feedback, we found that fine-tuning our model on both classification and explanation improves visual explanation while preserving classification accuracy, thus potentially increasing the trust of users in using CNN-based skin lesion classifiers.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationLesion ClassificationSkin Lesion ClassificationSimilar Papers 제목 키워드 기반
LesionAid: Vision Transformers-based Skin Lesion Generation and Classification
Skin cancer is one of the most prevalent forms of human cancer. It is recognized mainly visually, beginning with clinical screening and continuing with the dermoscopic examination, histological assessment, and specimen c…
ClassificationData AugmentationEdge-computingExplainable Artificial Intelligence (XAI)+1Investigating and Exploiting Image Resolution for Transfer Learning-based Skin Lesion Classification
Skin cancer is among the most common cancer types. Dermoscopic image analysis improves the diagnostic accuracy for detection of malignant melanoma and other pigmented skin lesions when compared to unaided visual inspecti…
ClassificationDiagnosticGeneral ClassificationLesion Classification+2SuperCon: Supervised Contrastive Learning for Imbalanced Skin Lesion Classification
Convolutional neural networks (CNNs) have achieved great success in skin lesion classification. A balanced dataset is required to train a good model. However, due to the appearance of different skin lesions in practice, …
ClassificationContrastive LearningLesion ClassificationSkin Lesion ClassificationAViT: Adapting Vision Transformers for Small Skin Lesion Segmentation Datasets
Skin lesion segmentation (SLS) plays an important role in skin lesion analysis. Vision transformers (ViTs) are considered an auspicious solution for SLS, but they require more training data compared to convolutional neur…
Lesion SegmentationSkin Lesion SegmentationPEFT-MedSAM: Efficient Fine-Tuning of Medical Foundation Models for Explainable Skin Lesion Segmentation
Automated segmentation of skin lesions using deep learning models for dermoscopic images can be very helpful in finding melanomas earlier than they would normally be detected. However, most deep learning methods availabl…
parameter-efficient fine-tuningSkin Lesion Segmentation