paper-with-me

홈 › Papers

SPCTNet: A Series-Parallel CNN and Transformer Network for 3D Medical Image Segmentation

2024-02-04 · journal 2024 2 · Bin Yu, Quan Zhou & Xuming Zhang

Medical image segmentation is crucial for lesion localization and surgical navigation. Recent advancements in medical image segmentation have been driven by Convolutional Neural Networks (CNNs) and Transformers. However, CNNs have limitations in capturing long-range dependencies due to their weight sharing and localized receptive fields, posing challenges in handling varying organ shapes. While Transformers offer an alternative with global receptive fields, their spatial and computational complexity is particularly high, especially for 3D medical images. To address this issue, we propose a novel series-parallel network that combines convolution and self-attention for 3D medical image segmentation. We utilize a serial 3D CNN as the encoder to extract multi-level feature maps, which are fused via a feature pyramid network. Subsequently, we adopt four parallel Transformer branches to capture global features. To efficiently model long-range information, we introduce patch self-attention, which divides the input into non-overlapping patches and computes attention between corresponding pixels across patches. Experimental evaluations on 3D MRI prostate and left atrial segmentation tasks confirm the superior performance of our network compared to other CNN and Transformer-based networks. Notably, our method achieves higher segmentation accuracy and faster inference speed.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
3D CNN 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

PHTrans: Parallelly Aggregating Global and Local Representations for Medical Image Segmentation

2022-03-09 · Wentao Liu, Tong Tian, Weijin Xu, Huihua Yang 외

The success of Transformer in computer vision has attracted increasing attention in the medical imaging community. Especially for medical image segmentation, many excellent hybrid architectures based on convolutional neu…

DecoderImage SegmentationMedical Image SegmentationSegmentation+1

Is it Time to Replace CNNs with Transformers for Medical Images?

2021-08-20 · Christos Matsoukas, Johan Fredin Haslum, Magnus Söderberg, Kevin Smith

Convolutional Neural Networks (CNNs) have reigned for a decade as the de facto approach to automated medical image diagnosis. Recently, vision transformers (ViTs) have appeared as a competitive alternative to CNNs, yield…

ParaTransCNN: Parallelized TransCNN Encoder for Medical Image Segmentation

2024-01-27 · Hongkun Sun, Jing Xu, Yuping Duan

The convolutional neural network-based methods have become more and more popular for medical image segmentation due to their outstanding performance. However, they struggle with capturing long-range dependencies, which a…

DecoderImage SegmentationMedical Image SegmentationSegmentation+1

Should we Replace CNNs with Transformers for Medical Images?

2021-09-29 · Christos Matsoukas, Johan Fredin Haslum, Moein Sorkhei, Magnus Soderberg 외

Convolutional Neural Networks (CNNs) have reigned for a decade as the de facto approach to automated medical image diagnosis, pushing the state-of-the-art in classification, detection and segmentation tasks. Recently, vi…

Segmentation

Pretrained ViTs Yield Versatile Representations For Medical Images

2023-03-13 · Christos Matsoukas, Johan Fredin Haslum, Moein Sorkhei, Magnus Söderberg 외

Convolutional Neural Networks (CNNs) have reigned for a decade as the de facto approach to automated medical image diagnosis, pushing the state-of-the-art in classification, detection and segmentation tasks. Over the las…

image-classificationImage ClassificationMedical Image Classification