paper-with-me

홈 › Papers

SwinCheX: Multi-label classification on chest X-ray images with transformers

2022-06-09 · Sina Taslimi, Soroush Taslimi, Nima Fathi, Mohammadreza Salehi, Mohammad Hossein Rohban

According to the considerable growth in the avail of chest X-ray images in diagnosing various diseases, as well as gathering extensive datasets, having an automated diagnosis procedure using deep neural networks has occupied the minds of experts. Most of the available methods in computer vision use a CNN backbone to acquire high accuracy on the classification problems. Nevertheless, recent researches show that transformers, established as the de facto method in NLP, can also outperform many CNN-based models in vision. This paper proposes a multi-label classification deep model based on the Swin Transformer as the backbone to achieve state-of-the-art diagnosis classification. It leverages Multi-Layer Perceptron, also known as MLP, for the head architecture. We evaluate our model on one of the most widely-used and largest x-ray datasets called "Chest X-ray14," which comprises more than 100,000 frontal/back-view images from over 30,000 patients with 14 famous chest diseases. Our model has been tested with several number of MLP layers for the head setting, each achieves a competitive AUC score on all classes. Comprehensive experiments on Chest X-ray14 have shown that a 3-layer head attains state-of-the-art performance with an average AUC score of 0.810, compared to the former SOTA average AUC of 0.799. We propose an experimental setup for the fair benchmarking of existing methods, which could be used as a basis for the future studies. Finally, we followed up our results by confirming that the proposed method attends to the pathologically relevant areas of the chest.

📄 PDF Abstract BibTeX arXiv:2206.04246

Code (1)

rohban-lab/swinchex 공식 구현 pytorch

Tasks

BenchmarkingMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
Adam 설명 없음

Similar Papers 제목 키워드 기반

A Relational-learning Perspective to Multi-label Chest X-ray Classification

2021-03-10 · Anjany Sekuboyina, Daniel Oñoro-Rubio, Jens Kleesiek, Brandon Malone

Multi-label classification of chest X-ray images is frequently performed using discriminative approaches, i.e. learning to map an image directly to its binary labels. Such approaches make it challenging to incorporate au…

ClassificationGeneral ClassificationLink PredictionMulti-Label Classification+4

LeDNet: Localization-enabled Deep Neural Network for Multi-Label Radiography Image Classification

2024-07-04 · Lalit Pant, Shubham Arora

Multi-label radiography image classification has long been a topic of interest in neural networks research. In this paper, we intend to classify such images using convolution neural networks with novel localization techn…

Classificationfeature selectionimage-classificationImage Classification

Domain Shift Analysis in Chest Radiographs Classification in a Veterans Healthcare Administration Population

2024-07-30 · Mayanka Chandrashekar, Ian Goethert, Md Inzamam Ul Haque, Benjamin McMahon 외

Objectives: This study aims to assess the impact of domain shift on chest X-ray classification accuracy and to analyze the influence of ground truth label quality and demographic factors such as age group, sex, and study…

ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONTransfer Learning+1

AnaXNet: Anatomy Aware Multi-label Finding Classification in Chest X-ray

2021-05-20 · Nkechinyere N. Agu, Joy T. Wu, Hanqing Chao, Ismini Lourentzou 외

Radiologists usually observe anatomical regions of chest X-ray images as well as the overall image before making a decision. However, most existing deep learning models only look at the entire X-ray image for classificat…

AnatomyClassificationimage-classificationImage Classification+1

Artificially Generated Visual Scanpath Improves Multi-label Thoracic Disease Classification in Chest X-Ray Images

2025-03-01 · Ashish Verma, Aupendu Kar, Krishnendu Ghosh, Sobhan Kanti Dhara 외

Expert radiologists visually scan Chest X-Ray (CXR) images, sequentially fixating on anatomical structures to perform disease diagnosis. An automatic multi-label classifier of diseases in CXR images can benefit by incorp…

Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATIONScanpath predictionThoracic Disease Classification