paper-with-me

홈 › Papers

SegStitch: Multidimensional Transformer for Robust and Efficient Medical Imaging Segmentation

2024-08-01 · Shengbo Tan, Zeyu Zhang, Ying Cai, Daji Ergu, Lin Wu, Binbin Hu, Pengzhang Yu, Yang Zhao

Medical imaging segmentation plays a significant role in the automatic recognition and analysis of lesions. State-of-the-art methods, particularly those utilizing transformers, have been prominently adopted in 3D semantic segmentation due to their superior performance in scalability and generalizability. However, plain vision transformers encounter challenges due to their neglect of local features and their high computational complexity. To address these challenges, we introduce three key contributions: Firstly, we proposed SegStitch, an innovative architecture that integrates transformers with denoising ODE blocks. Instead of taking whole 3D volumes as inputs, we adapt axial patches and customize patch-wise queries to ensure semantic consistency. Additionally, we conducted extensive experiments on the BTCV and ACDC datasets, achieving improvements up to 11.48% and 6.71% respectively in mDSC, compared to state-of-the-art methods. Lastly, our proposed method demonstrates outstanding efficiency, reducing the number of parameters by 36.7% and the number of FLOPS by 10.7% compared to UNETR. This advancement holds promising potential for adapting our method to real-world clinical practice. The code will be available at https://github.com/goblin327/SegStitch

📄 PDF Abstract BibTeX arXiv:2408.00496

Code (1)

goblin327/segstitch 공식 구현

Tasks

3D Semantic SegmentationDenoisingMedical Image SegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Batch Normalization 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Generalizable Single-Source Cross-modality Medical Image Segmentation via Invariant Causal Mechanisms

2024-11-07 · Boqi Chen, Yuanzhi Zhu, Yunke Ao, Sebastiano Caprara 외

Single-source domain generalization (SDG) aims to learn a model from a single source domain that can generalize well on unseen target domains. This is an important task in computer vision, particularly relevant to medica…

Domain GeneralizationImage SegmentationMedical Image SegmentationSemantic Segmentation+1

Vision Transformers in Medical Imaging: A Review

2022-11-18 · Emerald U. Henry, Onyeka Emebob, Conrad Asotie Omonhinmin

Transformer, a model comprising attention-based encoder-decoder architecture, have gained prevalence in the field of natural language processing (NLP) and recently influenced the computer vision (CV) space. The similarit…

DecoderDiversityimage-classificationImage Classification+1

Rethinking Attention Gated with Hybrid Dual Pyramid Transformer-CNN for Generalized Segmentation in Medical Imaging

2024-04-28 · Fares Bougourzi, Fadi Dornaika, Abdelmalik Taleb-Ahmed, Vinh Truong Hoang

Inspired by the success of Transformers in Computer vision, Transformers have been widely investigated for medical imaging segmentation. However, most of Transformer architecture are using the recent transformer architec…

Medical Image SegmentationSegmentation

CoM$^3$eT: A foundation model for medical image analysis through federated, multidimensional context integration

2026-08-17 · J. Raphael Schäfer, Kai Geissler, Till Nicke, Chiara Tappermann 외 arxiv

Medical foundation models improve generalization when training AI models with limited labeled data, but remain confined to a single specialty, such as pathology or radiology, and to either sparse or dense outputs, such a…

Federated Learning

MedVisionLlama: Leveraging Pre-Trained Large Language Model Layers to Enhance Medical Image Segmentation

2024-10-03 · Gurucharan Marthi Krishna Kumar, Aman Chadha, Janine Mendola, Amir Shmuel

Large Language Models (LLMs), known for their versatility in textual data, are increasingly being explored for their potential to enhance medical image segmentation, a crucial task for accurate diagnostic imaging. This s…

DiagnosticImage SegmentationLanguage ModelingLanguage Modelling+4