paper-with-me

홈 › Papers

A Comparative Study of CNN, ResNet, and Vision Transformers for Multi-Classification of Chest Diseases

2024-05-31 · Ananya Jain, Aviral Bhardwaj, Kaushik Murali, Isha Surani

Large language models, notably utilizing Transformer architectures, have emerged as powerful tools due to their scalability and ability to process large amounts of data. Dosovitskiy et al. expanded this architecture to introduce Vision Transformers (ViT), extending its applicability to image processing tasks. Motivated by this advancement, we fine-tuned two variants of ViT models, one pre-trained on ImageNet and another trained from scratch, using the NIH Chest X-ray dataset containing over 100,000 frontal-view X-ray images. Our study evaluates the performance of these models in the multi-label classification of 14 distinct diseases, while using Convolutional Neural Networks (CNNs) and ResNet architectures as baseline models for comparison. Through rigorous assessment based on accuracy metrics, we identify that the pre-trained ViT model surpasses CNNs and ResNet in this multilabel classification task, highlighting its potential for accurate diagnosis of various lung conditions from chest X-ray images.

📄 PDF Abstract BibTeX arXiv:2406.00237

Code (1)

Aviral-03/ViT-Chest-Xray 공식 구현

Tasks

Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Kaiming Initialization 설명 없음
Average Pooling 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

A comparative study between vision transformers and CNNs in digital pathology

2022-06-01 · Luca Deininger, Bernhard Stimpel, Anil Yuce, Samaneh Abbasi-Sureshjani 외

Recently, vision transformers were shown to be capable of outperforming convolutional neural networks when pretrained on sufficient amounts of data. In comparison to convolutional neural networks, vision transformers hav…

Inductive Biaswhole slide images

Vision Transformers for Kidney Stone Image Classification: A Comparative Study with CNNs

2025-08-19 · Ivan Reyes-Amezcua, Francisco Lopez-Tiro, Clement Larose, Andres Mendez-Vazquez 외 arxiv

Kidney stone classification from endoscopic images is critical for personalized treatment and recurrence prevention. While convolutional neural networks (CNNs) have shown promise in this task, their limited ability to ca…

Image Classification

Comparative Analysis of Vision Transformers and Convolutional Neural Networks for Medical Image Classification

2025-07-24 · Kunal Kawadkar arxiv

The emergence of Vision Transformers (ViTs) has revolutionized computer vision, yet their effectiveness compared to traditional Convolutional Neural Networks (CNNs) in medical imaging remains under-explored. This study p…

Medical Image ClassificationSkin Cancer ClassificationBrain Tumor ClassificationPneumonia Detection

Vision Transformers for Weakly-Supervised Microorganism Enumeration

2024-12-03 · Javier Ureña Santiago, Thomas Ströhle, Antonio Rodríguez-Sánchez, Ruth Breu

Microorganism enumeration is an essential task in many applications, such as assessing contamination levels or ensuring health standards when evaluating surface cleanliness. However, it's traditionally performed by human…

Density EstimationInstance SegmentationObject CountingSemantic Segmentation

Architectural Bias in Face Presentation Attack Detection: A Comparative Study of Vision Transformers and Convolutional Neural Networks

2026-06-16 · Ngela Landon Ntung, Floride Tuyisenge, Jema David Ndibwile arxiv

Face Presentation Attack Detection (PAD) systems constitute a critical security layer in biometric authentication; however, existing approaches exhibit systematic performance disparities across demographic groups, dispro…

Face Presentation Attack DetectionFace Anti-Spoofing