CNN-based Local Vision Transformer for COVID-19 Diagnosis

2022-07-05 · Hongyan Xu, Xiu Su, Dadong Wang

Deep learning technology can be used as an assistive technology to help doctors quickly and accurately identify COVID-19 infections. Recently, Vision Transformer (ViT) has shown great potential towards image classification due to its global receptive field. However, due to the lack of inductive biases inherent to CNNs, the ViT-based structure leads to limited feature richness and difficulty in model training. In this paper, we propose a new structure called Transformer for COVID-19 (COVT) to improve the performance of ViT-based architectures on small COVID-19 datasets. It uses CNN as a feature extractor to effectively extract local structural information, and introduces average pooling to ViT's Multilayer Perception(MLP) module for global information. Experiments show the effectiveness of our method on the two COVID-19 datasets and the ImageNet dataset.

📄 PDF Abstract BibTeX arXiv:2207.02027

Code (0)

등록된 구현이 없습니다.

Tasks

COVID-19 Diagnosis image-classification Image Classification

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Adam 설명 없음

MVC: A Multi-Task Vision Transformer Network for COVID-19 Diagnosis from Chest X-ray Images

2023-09-30 · Huyen Tran, Duc Thanh Nguyen, John Yearwood

Medical image analysis using computer-based algorithms has attracted considerable attention from the research community and achieved tremendous progress in the last decade. With recent advances in computing resources and…

COVID-19 Diagnosis image-classification Image Classification Medical Image Analysis+1

Vision Transformer for COVID-19 CXR Diagnosis using Chest X-ray Feature Corpus

2021-03-12 · Sangjoon Park, Gwanghyun Kim, Yujin Oh, Joon Beom Seo 외

Under the global COVID-19 crisis, developing robust diagnosis algorithm for COVID-19 using CXR is hampered by the lack of the well-curated COVID-19 data set, although CXR data with other disease are abundant. This situat…

Study of Vision Transformers for Covid-19 Detection from Chest X-rays

2023-07-17 · Sandeep Angara, Sharath Thirunagaru

The COVID-19 pandemic has led to a global health crisis, highlighting the need for rapid and accurate virus detection. This research paper examines transfer learning with vision transformers for COVID-19 detection, known…

Transfer Learning

PVT-COV19D: Pyramid Vision Transformer for COVID-19 Diagnosis

2022-06-30 · Lilang Zheng, Jiaxuan Fang, Xiaorun Tang, Hanzhang Li 외

With the outbreak of COVID-19, a large number of relevant studies have emerged in recent years. We propose an automatic COVID-19 diagnosis framework based on lung CT scan images, the PVT-COV19D. In order to accommodate t…

COVID-19 Diagnosis

Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantification

2021-04-15 · Sangjoon Park, Gwanghyun Kim, Yujin Oh, Joon Beom Seo 외

Developing a robust algorithm to diagnose and quantify the severity of COVID-19 using Chest X-ray (CXR) requires a large number of well-curated COVID-19 datasets, which is difficult to collect under the global COVID-19 p…