Convolutional Nets Versus Vision Transformers for Diabetic Foot Ulcer Classification
This paper compares well-established Convolutional Neural Networks (CNNs) to recently introduced Vision Transformers for the task of Diabetic Foot Ulcer Classification, in the context of the DFUC 2021 Grand-Challenge, in which this work attained the first position. Comprehensive experiments demonstrate that modern CNNs are still capable of outperforming Transformers in a low-data regime, likely owing to their ability for better exploiting spatial correlations. In addition, we empirically demonstrate that the recent Sharpness-Aware Minimization (SAM) optimization algorithm considerably improves the generalization capability of both kinds of models. Our results demonstrate that for this task, the combination of CNNs and the SAM optimization process results in superior performance than any other of the considered approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationPositionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Conv2Former: A Simple Transformer-Style ConvNet for Visual Recognition
This paper does not attempt to design a state-of-the-art method for visual recognition but investigates a more efficient way to make use of convolutions to encode spatial features. By comparing the design principles of t…
object-detectionObject DetectionSemantic SegmentationDeep Residual Network based Automatic Image Grading for Diabetic Macular Edema
Diabetic Macular Edema (DME) is an advanced symptom of diabetic retinopathy that affects central vision of diabetes patients. An automated system for early detection of DME symptom has been proposed herein to elude visio…
Fovea Detectionimage-classificationImage ClassificationMedical Image Analysis+3Transfer-Ensemble Learning based Deep Convolutional Neural Networks for Diabetic Retinopathy Classification
This article aims to classify diabetic retinopathy (DR) disease into five different classes using an ensemble approach based on two popular pre-trained convolutional neural networks: VGG16 and Inception V3. The proposed …
Ensemble LearningAdversarial Token Attacks on Vision Transformers
Vision transformers rely on a patch token based self attention mechanism, in contrast to convolutional networks. We investigate fundamental differences between these two families of models, by designing a block sparsity …
ACC-UNet: A Completely Convolutional UNet model for the 2020s
This decade is marked by the introduction of Vision Transformer, a radical paradigm shift in broad computer vision. A similar trend is followed in medical imaging, UNet, one of the most influential architectures, has bee…
Image SegmentationMedical Image SegmentationSemantic Segmentation