Dual Cross-Attention for Medical Image Segmentation
We propose Dual Cross-Attention (DCA), a simple yet effective attention module that is able to enhance skip-connections in U-Net-based architectures for medical image segmentation. DCA addresses the semantic gap between encoder and decoder features by sequentially capturing channel and spatial dependencies across multi-scale encoder features. First, the Channel Cross-Attention (CCA) extracts global channel-wise dependencies by utilizing cross-attention across channel tokens of multi-scale encoder features. Then, the Spatial Cross-Attention (SCA) module performs cross-attention to capture spatial dependencies across spatial tokens. Finally, these fine-grained encoder features are up-sampled and connected to their corresponding decoder parts to form the skip-connection scheme. Our proposed DCA module can be integrated into any encoder-decoder architecture with skip-connections such as U-Net and its variants. We test our DCA module by integrating it into six U-Net-based architectures such as U-Net, V-Net, R2Unet, ResUnet++, DoubleUnet and MultiResUnet. Our DCA module shows Dice Score improvements up to 2.05% on GlaS, 2.74% on MoNuSeg, 1.37% on CVC-ClinicDB, 1.12% on Kvasir-Seg and 1.44% on Synapse datasets. Our codes are available at: https://github.com/gorkemcanates/Dual-Cross-Attention
Code (1)
Tasks
DecoderMedical Image SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DB-SAM: Delving into High Quality Universal Medical Image Segmentation
Recently, the Segment Anything Model (SAM) has demonstrated promising segmentation capabilities in a variety of downstream segmentation tasks. However in the context of universal medical image segmentation there exists a…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationBEFUnet: A Hybrid CNN-Transformer Architecture for Precise Medical Image Segmentation
The accurate segmentation of medical images is critical for various healthcare applications. Convolutional neural networks (CNNs), especially Fully Convolutional Networks (FCNs) like U-Net, have shown remarkable success …
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationMCANet: Medical Image Segmentation with Multi-Scale Cross-Axis Attention
Efficiently capturing multi-scale information and building long-range dependencies among pixels are essential for medical image segmentation because of the various sizes and shapes of the lesion regions or organs. In thi…
Image SegmentationLesion SegmentationMedical Image SegmentationOrgan Segmentation+3Lagrange Duality and Compound Multi-Attention Transformer for Semi-Supervised Medical Image Segmentation
Medical image segmentation, a critical application of semantic segmentation in healthcare, has seen significant advancements through specialized computer vision techniques. While deep learning-based medical image segment…
Image SegmentationMedical DiagnosisMedical Image SegmentationSegmentation+2FocusNet++: Attentive Aggregated Transformations for Efficient and Accurate Medical Image Segmentation
We propose a new residual block for convolutional neural networks and demonstrate its state-of-the-art performance in medical image segmentation. We combine attention mechanisms with group convolutions to create our grou…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation