paper-with-me

홈 › Papers

Optimizing Medical Image Segmentation with Advanced Decoder Design

2024-10-05 · Weibin Yang, Zhiqi Dong, Mingyuan Xu, Longwei Xu, Dehua Geng, Yusong Li, Pengwei Wang

U-Net is widely used in medical image segmentation due to its simple and flexible architecture design. To address the challenges of scale and complexity in medical tasks, several variants of U-Net have been proposed. In particular, methods based on Vision Transformer (ViT), represented by Swin UNETR, have gained widespread attention in recent years. However, these improvements often focus on the encoder, overlooking the crucial role of the decoder in optimizing segmentation details. This design imbalance limits the potential for further enhancing segmentation performance. To address this issue, we analyze the roles of various decoder components, including upsampling method, skip connection, and feature extraction module, as well as the shortcomings of existing methods. Consequently, we propose Swin DER (i.e., Swin UNETR Decoder Enhanced and Refined) by specifically optimizing the design of these three components. Swin DER performs upsampling using learnable interpolation algorithm called offset coordinate neighborhood weighted up sampling (Onsampling) and replaces traditional skip connection with spatial-channel parallel attention gate (SCP AG). Additionally, Swin DER introduces deformable convolution along with attention mechanism in the feature extraction module of the decoder. Our model design achieves excellent results, surpassing other state-of-the-art methods on both the Synapse and the MSD brain tumor segmentation task. Code is available at: https://github.com/WillBeanYang/Swin-DER

📄 PDF Abstract BibTeX arXiv:2410.04128

Code (1)

willbeanyang/swin-der 공식 구현 pytorch

Tasks

Brain Tumor SegmentationDecoderImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationTumor Segmentation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

MixSearch: Searching for Domain Generalized Medical Image Segmentation Architectures

2021-02-26 · Luyan Liu, Zhiwei Wen, Songwei Liu, Hong-Yu Zhou 외

Considering the scarcity of medical data, most datasets in medical image analysis are an order of magnitude smaller than those of natural images. However, most Network Architecture Search (NAS) approaches in medical imag…

DecoderImage SegmentationMedical Image AnalysisMedical Image Segmentation+2

MS-UNet-v2: Adaptive Denoising Method and Training Strategy for Medical Image Segmentation with Small Training Data

2023-09-07 · HaoYuan Chen, Yufei Han, Pin Xu, Yanyi Li 외

Models based on U-like structures have improved the performance of medical image segmentation. However, the single-layer decoder structure of U-Net is too "thin" to exploit enough information, resulting in large semantic…

DecoderDenoisingImage SegmentationMedical Image Segmentation+2

D-TrAttUnet: Toward Hybrid CNN-Transformer Architecture for Generic and Subtle Segmentation in Medical Images

2024-05-07 · Fares Bougourzi, Fadi Dornaika, Cosimo Distante, Abdelmalik Taleb-Ahmed

Over the past two decades, machine analysis of medical imaging has advanced rapidly, opening up significant potential for several important medical applications. As complicated diseases increase and the number of cases r…

DecoderLesion SegmentationMedical Image AnalysisSegmentation

Scalable Neural Architecture Search for 3D Medical Image Segmentation

2019-06-13 · Sungwoong Kim, Ildoo Kim, Sungbin Lim, Woonhyuk Baek 외

In this paper, a neural architecture search (NAS) framework is proposed for 3D medical image segmentation, to automatically optimize a neural architecture from a large design space. Our NAS framework searches the structu…

DecoderImage SegmentationMedical Image SegmentationNeural Architecture Search+2

QTSeg: A Query Token-Based Architecture for Efficient 2D Medical Image Segmentation

2024-12-23 · Phuong-Nam Tran, Nhat Truong Pham, Duc Ngoc Minh Dang, Eui-Nam Huh 외

Medical image segmentation is crucial in assisting medical doctors in making diagnoses and enabling accurate automatic diagnosis. While advanced convolutional neural networks (CNNs) excel in segmenting regions of interes…

Breast Cancer DetectionDecoderImage SegmentationMedical Image Segmentation+2