paper-with-me

홈 › Papers

Attention Swin U-Net: Cross-Contextual Attention Mechanism for Skin Lesion Segmentation

2022-10-30 · Ehsan Khodapanah Aghdam, Reza Azad, Maral Zarvani, Dorit Merhof

Melanoma is caused by the abnormal growth of melanocytes in human skin. Like other cancers, this life-threatening skin cancer can be treated with early diagnosis. To support a diagnosis by automatic skin lesion segmentation, several Fully Convolutional Network (FCN) approaches, specifically the U-Net architecture, have been proposed. The U-Net model with a symmetrical architecture has exhibited superior performance in the segmentation task. However, the locality restriction of the convolutional operation incorporated in the U-Net architecture limits its performance in capturing long-range dependency, which is crucial for the segmentation task in medical images. To address this limitation, recently a Transformer based U-Net architecture that replaces the CNN blocks with the Swin Transformer module has been proposed to capture both local and global representation. In this paper, we propose Att-SwinU-Net, an attention-based Swin U-Net extension, for medical image segmentation. In our design, we seek to enhance the feature re-usability of the network by carefully designing the skip connection path. We argue that the classical concatenation operation utilized in the skip connection path can be further improved by incorporating an attention mechanism. By performing a comprehensive ablation study on several skin lesion segmentation datasets, we demonstrate the effectiveness of our proposed attention mechanism.

📄 PDF Abstract BibTeX arXiv:2210.16898

Code (1)

nitr098/attswinunet 공식 구현 pytorch

Tasks

Image SegmentationLesion SegmentationMedical Image SegmentationSegmentationSemantic SegmentationSkin Lesion Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Adam 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…

Similar Papers 제목 키워드 기반

ViT-LSLA: Vision Transformer with Light Self-Limited-Attention

2022-10-31 · Zhenzhe Hechen, Wei Huang, Yixin Zhao

Transformers have demonstrated a competitive performance across a wide range of vision tasks, while it is very expensive to compute the global self-attention. Many methods limit the range of attention within a local wind…

Position

Multi-modal brain MRI synthesis based on SwinUNETR

2025-06-03 · Haowen Pang, Weiyan Guo, Chuyang Ye

Multi-modal brain magnetic resonance imaging (MRI) plays a crucial role in clinical diagnostics by providing complementary information across different imaging modalities. However, a common challenge in clinical practice…

DiagnosticMedical Image Analysis

SwinECAT: A Transformer-based fundus disease classification model with Shifted Window Attention and Efficient Channel Attention

2025-07-29 · Peiran Gu, Teng Yao, Mengshen He, Fuhao Duan 외 arxiv

In recent years, artificial intelligence has been increasingly applied in the field of medical imaging. Among these applications, fundus image analysis presents special challenges, including small lesion areas in certain…

A Novel Shape Guided Transformer Network for Instance Segmentation in Remote Sensing Images

2024-12-31 · Dawen Yu, Shunping Ji

Instance segmentation performance in remote sensing images (RSIs) is significantly affected by two issues: how to extract accurate boundaries of objects from remote imaging through the dynamic atmosphere, and how to inte…

Instance SegmentationSegmentationSemantic Segmentation

HAAT: Hybrid Attention Aggregation Transformer for Image Super-Resolution

2024-11-27 · Song-Jiang Lai, Tsun-Hin Cheung, Ka-Chun Fung, Kai-wen Xue 외

In the research area of image super-resolution, Swin-transformer-based models are favored for their global spatial modeling and shifting window attention mechanism. However, existing methods often limit self-attention to…

Image Super-ResolutionSuper-Resolution