paper-with-me

홈 › Papers

D-TrAttUnet: Dual-Decoder Transformer-Based Attention Unet Architecture for Binary and Multi-classes Covid-19 Infection Segmentation

2023-03-27 · Fares Bougourzi, Cosimo Distante, Fadi Dornaika, Abdelmalik Taleb-Ahmed

In the last three years, the world has been facing a global crisis caused by Covid-19 pandemic. Medical imaging has been playing a crucial role in the fighting against this disease and saving the human lives. Indeed, CT-scans has proved their efficiency in diagnosing, detecting, and following-up the Covid-19 infection. In this paper, we propose a new Transformer-CNN based approach for Covid-19 infection segmentation from the CT slices. The proposed D-TrAttUnet architecture has an Encoder-Decoder structure, where compound Transformer-CNN encoder and Dual-Decoders are proposed. The Transformer-CNN encoder is built using Transformer layers, UpResBlocks, ResBlocks and max-pooling layers. The Dual-Decoder consists of two identical CNN decoders with attention gates. The two decoders are used to segment the infection and the lung regions simultaneously and the losses of the two tasks are joined. The proposed D-TrAttUnet architecture is evaluated for both Binary and Multi-classes Covid-19 infection segmentation. The experimental results prove the efficiency of the proposed approach to deal with the complexity of Covid-19 segmentation task from limited data. Furthermore, D-TrAttUnet architecture outperforms three baseline CNN segmentation architectures (Unet, AttUnet and Unet++) and three state-of-the-art architectures (AnamNet, SCOATNet and CopleNet), in both Binary and Mutli-classes segmentation tasks.

📄 PDF Abstract BibTeX arXiv:2303.15576

Code (3)

faresbougourzi/d-trattunet 공식 구현 pytorch
MindSpore-scientific-2/code-9/tree/main/D-Unet_Mindspore mindspore
MindSpore-scientific/code-12/tree/main/D-Unet_Mindspore mindspore

Tasks

DecoderSegmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

D-TrAttUnet: Toward Hybrid CNN-Transformer Architecture for Generic and Subtle Segmentation in Medical Images

2024-05-07 · Fares Bougourzi, Fadi Dornaika, Cosimo Distante, Abdelmalik Taleb-Ahmed

Over the past two decades, machine analysis of medical imaging has advanced rapidly, opening up significant potential for several important medical applications. As complicated diseases increase and the number of cases r…

DecoderLesion SegmentationMedical Image AnalysisSegmentation

SDSC-UNet: Dual Skip Connection ViT-based U-shaped Model for Building Extraction

2023-04-25 · IEEE Geoscience and Remote Sensing Letters 2023 4 · Renhe Zhang, Qian Zhang, Guixu Zhang

Benefiting from effective global information interaction, vision-transformers (ViTs) have been widely used in the building extraction task. However, buildings in remote sensing (RS) images usually differ greatly in size.…

DecoderExtracting Buildings In Remote Sensing ImagesSemantic Segmentation

DS-TransUNet:Dual Swin Transformer U-Net for Medical Image Segmentation

2021-06-12 · Ailiang Lin, Bingzhi Chen, Jiayu Xu, Zheng Zhang 외

Automatic medical image segmentation has made great progress benefit from the development of deep learning. However, most existing methods are based on convolutional neural networks (CNNs), which fail to build long-range…

DecoderImage SegmentationMedical Image SegmentationSegmentation+1

Transformer-Unet: Raw Image Processing with Unet

2021-09-17 · Youyang Sha, Yonghong Zhang, Xuquan Ji, Lei Hu

Medical image segmentation have drawn massive attention as it is important in biomedical image analysis. Good segmentation results can assist doctors with their judgement and further improve patients' experience. Among m…

Decoderimage-classificationImage ClassificationImage Segmentation+7

DA-TransUNet: Integrating Spatial and Channel Dual Attention with Transformer U-Net for Medical Image Segmentation

2023-10-19 · Guanqun Sun, Yizhi Pan, Weikun Kong, Zichang Xu 외

Accurate medical image segmentation is critical for disease quantification and treatment evaluation. While traditional Unet architectures and their transformer-integrated variants excel in automated segmentation tasks. H…

Image SegmentationMedical Image SegmentationRepresentation LearningSegmentation+1