paper-with-me

홈 › Papers

GCtx-UNet: Efficient Network for Medical Image Segmentation

2024-06-09 · Khaled Alrfou, Tian Zhao

Medical image segmentation is crucial for disease diagnosis and monitoring. Though effective, the current segmentation networks such as UNet struggle with capturing long-range features. More accurate models such as TransUNet, Swin-UNet, and CS-UNet have higher computation complexity. To address this problem, we propose GCtx-UNet, a lightweight segmentation architecture that can capture global and local image features with accuracy better or comparable to the state-of-the-art approaches. GCtx-UNet uses vision transformer that leverages global context self-attention modules joined with local self-attention to model long and short range spatial dependencies. GCtx-UNet is evaluated on the Synapse multi-organ abdominal CT dataset, the ACDC cardiac MRI dataset, and several polyp segmentation datasets. In terms of Dice Similarity Coefficient (DSC) and Hausdorff Distance (HD) metrics, GCtx-UNet outperformed CNN-based and Transformer-based approaches, with notable gains in the segmentation of complex and small anatomical structures. Moreover, GCtx-UNet is much more efficient than the state-of-the-art approaches with smaller model size, lower computation workload, and faster training and inference speed, making it a practical choice for clinical applications.

📄 PDF Abstract BibTeX arXiv:2406.05891

Code (1)

kalrfou/gctx-unet 공식 구현 pytorch

Tasks

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…

Similar Papers 제목 키워드 기반

KM-UNet KAN Mamba UNet for medical image segmentation

2025-01-05 · Yibo Zhang

Medical image segmentation is a critical task in medical imaging analysis. Traditional CNN-based methods struggle with modeling long-range dependencies, while Transformer-based models, despite their success, suffer from …

Computational EfficiencyImage SegmentationKolmogorov-Arnold NetworksLong-range modeling+5

TP-UNet: Temporal Prompt Guided UNet for Medical Image Segmentation

2024-11-18 · Ranmin Wang, Limin Zhuang, Hongkun Chen, Boyan Xu 외

The advancement of medical image segmentation techniques has been propelled by the adoption of deep learning techniques, particularly UNet-based approaches, which exploit semantic information to improve the accuracy of s…

Contrastive LearningImage SegmentationMedical Image SegmentationSegmentation+1

Deep Learning-based Bio-Medical Image Segmentation using UNet Architecture and Transfer Learning

2023-05-24 · Nima Hassanpour, Abouzar Ghavami

Image segmentation is a branch of computer vision that is widely used in real world applications including biomedical image processing. With recent advancement of deep learning, image segmentation has achieved at a very …

Deep LearningImage SegmentationMedical Image SegmentationSegmentation+3

UNet++: A Nested U-Net Architecture for Medical Image Segmentation

2018-07-18 · Zongwei Zhou, Md Mahfuzur Rahman Siddiquee, Nima Tajbakhsh, Jianming Liang

Implementation of different kinds of Unet Models for Image Segmentation - Unet , RCNN-Unet, Attention Unet, RCNN-Attention Unet, Nested Unet

Camouflaged Object SegmentationImage SegmentationMedical Image SegmentationSegmentation+3

TTT-Unet: Enhancing U-Net with Test-Time Training Layers for Biomedical Image Segmentation

2024-09-17 · Rong Zhou, Zhengqing Yuan, Zhiling Yan, Weixiang Sun 외

Biomedical image segmentation is crucial for accurately diagnosing and analyzing various diseases. However, Convolutional Neural Networks (CNNs) and Transformers, the most commonly used architectures for this task, strug…

Cell SegmentationImage SegmentationOrgan SegmentationSegmentation+1