paper-with-me

홈 › Papers

CNNs, Transformers, Hybrid, and Vision Language Models for Skin Cancer Detection

2026-05-25 · Durjoy Dey, Yuhong Yan, Hassan Hajjdiab arxiv

Skin cancer is a common and fast rising malignancy worldwide. Early detection is critical for improving outcomes. Deep learning models trained on dermoscopic and clinical images can support automated and fast triage. However, many studies evaluate only a limited set of architectures. Experimental setups also vary across studies. In this paper, we present a unified evaluation of twelve deep learning models for binary skin cancer detection on the PAD-UFES-20 dataset. The models span four families: convolutional neural networks (CNN), vision transformers (ViT), hybrid convolution transformer backbones, and vision language models (VLM). Performance is assessed using AUC, the maximum F1 score with its precision and recall, and sensitivity at 80% specificity, reflecting screening oriented requirements. Our results show that well tuned CNNs already provide strong baselines, but transformer based families consistently improve discrimination. Hybrid models (MaxViT Tiny, CoAtNet0) and a SigLIP based VLM achieve the best overall trade off between ranking performance and clinically relevant operating points, while CLIP based model offers high precision. The full codebase for all experiments is publicly released. Together, these findings offer practical guidance on which model families are most suitable for real world deployment in skin cancer screening and establish a reproducible reference point for future work on PAD-UFES-20.

📄 PDF Abstract BibTeX arXiv:2605.26294

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ASP-VMUNet: Atrous Shifted Parallel Vision Mamba U-Net for Skin Lesion Segmentation

2025-03-25 · Muyi Bao, Shuchang Lyu, Zhaoyang Xu, Qi Zhao 외

Skin lesion segmentation is a critical challenge in computer vision, and it is essential to separate pathological features from healthy skin for diagnostics accurately. Traditional Convolutional Neural Networks (CNNs) ar…

Image SegmentationLesion SegmentationMambaMedical Image Segmentation+3

HySparK: Hybrid Sparse Masking for Large Scale Medical Image Pre-Training

2024-08-11 · Fenghe Tang, Ronghao Xu, Qingsong Yao, Xueming Fu 외

The generative self-supervised learning strategy exhibits remarkable learning representational capabilities. However, there is limited attention to end-to-end pre-training methods based on a hybrid architecture of CNN an…

DecoderSelf-Supervised Learning

A survey of the Vision Transformers and their CNN-Transformer based Variants

2023-05-17 · Asifullah Khan, Zunaira Rauf, Anabia Sohail, Abdul Rehman 외

Vision transformers have become popular as a possible substitute to convolutional neural networks (CNNs) for a variety of computer vision applications. These transformers, with their ability to focus on global relationsh…

Survey

PETAH: Parameter Efficient Task Adaptation for Hybrid Transformers in a resource-limited Context

2024-10-23 · Maximilian Augustin, Syed Shakib Sarwar, Mostafa Elhoushi, Sai Qian Zhang 외

Following their success in natural language processing (NLP), there has been a shift towards transformer models in computer vision. While transformers perform well and offer promising multi-tasking performance, due to th…

Gaze Estimation using Transformer

2021-05-30 · Yihua Cheng, Feng Lu

Recent work has proven the effectiveness of transformers in many computer vision tasks. However, the performance of transformers in gaze estimation is still unexplored. In this paper, we employ transformers and assess th…

Gaze Estimation