COVID-19 Detection in Chest X-ray Images Using Swin-Transformer and Transformer in Transformer

2021-10-16 · Juntao Jiang, Shuyi Lin

The Coronavirus Disease 2019 (COVID-19) has spread globally and caused serious damage. Chest X-ray images are widely used for COVID-19 diagnosis and the Artificial Intelligence method can increase efficiency and accuracy. In the Challenge of Chest XR COVID-19 detection in Ethics and Explainability for Responsible Data Science (EE-RDS) conference 2021, we proposed a method that combined Swin Transformer and Transformer in Transformer to classify chest X-ray images as three classes: COVID-19, Pneumonia, and Normal (healthy) and achieved 0.9475 accuracies on the test set.

📄 PDF Abstract BibTeX arXiv:2110.08427

Code (0)

등록된 구현이 없습니다.

Tasks

COVID-19 Diagnosis Ethics

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Test 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Study of Vision Transformers for Covid-19 Detection from Chest X-rays

2023-07-17 · Sandeep Angara, Sharath Thirunagaru

The COVID-19 pandemic has led to a global health crisis, highlighting the need for rapid and accurate virus detection. This research paper examines transfer learning with vision transformers for COVID-19 detection, known…

Transfer Learning

Multi Source COVID-19 Detection via Kernel-Density-based Slice Sampling

2025-07-02 · Chia-Ming Lee, Bo-Cheng Qiu, Ting-Yao Chen, Ming-Han Sun 외 arxiv

We present our solution for the Multi-Source COVID-19 Detection Challenge, which classifies chest CT scans from four distinct medical centers. To address multi-source variability, we employ the Spatial-Slice Feature Lear…

A hybrid deep learning framework for Covid-19 detection via 3D Chest CT Images

2021-07-08 · Shuang Liang

In this paper, we present a hybrid deep learning framework named CTNet which combines convolutional neural network and transformer together for the detection of COVID-19 via 3D chest CT images. It consists of a CNN featu…

COVID-19 Diagnosis

An efficient method of detection of COVID-19 using Mask R-CNN on chest X-Ray images

2021-07-12 · journal 2021 7 · Soumyajit Podder, Somnath Bhattacharjee, Arijit Roy

Artificial intelligence techniques are used on chest X-ray images for accurate detection of diseases and this paper aims to develop a process which is capable of diagnosing COVID-19 using deep learning methods on X-ray i…

Specificity

Self-Knowledge Distillation based Self-Supervised Learning for Covid-19 Detection from Chest X-Ray Images

2022-06-07 · Guang Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

The global outbreak of the Coronavirus 2019 (COVID-19) has overloaded worldwide healthcare systems. Computer-aided diagnosis for COVID-19 fast detection and patient triage is becoming critical. This paper proposes a nove…

Knowledge Distillation Self-Knowledge Distillation Self-Supervised Learning