paper-with-me

홈 › Papers

High-Resolution Swin Transformer for Automatic Medical Image Segmentation

2022-07-23 · Chen Wei, Shenghan Ren, Kaitai Guo, Haihong Hu, Jimin Liang

The Resolution of feature maps is critical for medical image segmentation. Most of the existing Transformer-based networks for medical image segmentation are U-Net-like architecture that contains an encoder that utilizes a sequence of Transformer blocks to convert the input medical image from high-resolution representation into low-resolution feature maps and a decoder that gradually recovers the high-resolution representation from low-resolution feature maps. Unlike previous studies, in this paper, we utilize the network design style from the High-Resolution Network (HRNet), replace the convolutional layers with Transformer blocks, and continuously exchange information from the different resolution feature maps that are generated by Transformer blocks. The newly Transformer-based network presented in this paper is denoted as High-Resolution Swin Transformer Network (HRSTNet). Extensive experiments illustrate that HRSTNet can achieve comparable performance with the state-of-the-art Transformer-based U-Net-like architecture on Brain Tumor Segmentation(BraTS) 2021 and the liver dataset from Medical Segmentation Decathlon. The code of HRSTNet will be publicly available at https://github.com/auroua/HRSTNet.

📄 PDF Abstract BibTeX arXiv:2207.11553

Code (1)

auroua/hrstnet 공식 구현 pytorch

Tasks

Brain Tumor SegmentationDecoderImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationTumor SegmentationVocal Bursts Intensity Prediction

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

RFR-WWANet: Weighted Window Attention-Based Recovery Feature Resolution Network for Unsupervised Image Registration

2023-05-07 · Mingrui Ma, Tao Wang, Lei Song, Weijie Wang 외

The Swin transformer has recently attracted attention in medical image analysis due to its computational efficiency and long-range modeling capability. Owing to these properties, the Swin Transformer is suitable for esta…

Computational EfficiencyImage RegistrationLong-range modelingMedical Image Analysis+1

Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation

2021-05-12 · Hu Cao, Yueyue Wang, Joy Chen, Dongsheng Jiang 외

In the past few years, convolutional neural networks (CNNs) have achieved milestones in medical image analysis. Especially, the deep neural networks based on U-shaped architecture and skip-connections have been widely ap…

Cardiac SegmentationDecoderImage SegmentationMedical Image Analysis+2

Single Image Super-Resolution Using Lightweight Networks Based on Swin Transformer

2022-10-20 · Bolong Zhang, Juan Chen, Quan Wen

Image super-resolution reconstruction is an important task in the field of image processing technology, which can restore low resolution image to high quality image with high resolution. In recent years, deep learning ha…

Image Super-ResolutionSuper-Resolution

Full Contextual Attention for Multi-resolution Transformers in Semantic Segmentation

2022-12-15 · Loic Themyr, Clement Rambour, Nicolas Thome, Toby Collins 외

Transformers have proved to be very effective for visual recognition tasks. In particular, vision transformers construct compressed global representations through self-attention and learnable class tokens. Multi-resoluti…

Semantic Segmentation

CSWin-UNet: Transformer UNet with Cross-Shaped Windows for Medical Image Segmentation

2024-07-25 · Xiao Liu, Peng Gao, Tao Yu, Fei Wang 외

Deep learning, especially convolutional neural networks (CNNs) and Transformer architectures, have become the focus of extensive research in medical image segmentation, achieving impressive results. However, CNNs come wi…

Computational EfficiencyDecoderImage SegmentationMedical Image Segmentation+2