Attention Mechanisms in Medical Image Segmentation: A Survey
Medical image segmentation plays an important role in computer-aided diagnosis. Attention mechanisms that distinguish important parts from irrelevant parts have been widely used in medical image segmentation tasks. This paper systematically reviews the basic principles of attention mechanisms and their applications in medical image segmentation. First, we review the basic concepts of attention mechanism and formulation. Second, we surveyed over 300 articles related to medical image segmentation, and divided them into two groups based on their attention mechanisms, non-Transformer attention and Transformer attention. In each group, we deeply analyze the attention mechanisms from three aspects based on the current literature work, i.e., the principle of the mechanism (what to use), implementation methods (how to use), and application tasks (where to use). We also thoroughly analyzed the advantages and limitations of their applications to different tasks. Finally, we summarize the current state of research and shortcomings in the field, and discuss the potential challenges in the future, including task specificity, robustness, standard evaluation, etc. We hope that this review can showcase the overall research context of traditional and Transformer attention methods, provide a clear reference for subsequent research, and inspire more advanced attention research, not only in medical image segmentation, but also in other image analysis scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationSpecificitySurveyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Advances in Medical Image Segmentation: A Comprehensive Survey with a Focus on Lumbar Spine Applications
Medical Image Segmentation (MIS) stands as a cornerstone in medical image analysis, playing a pivotal role in precise diagnostics, treatment planning, and monitoring of various medical conditions. This paper presents a c…
Medical Image SegmentationDomain AdaptationActive LearningEdge DetectionIs the medical image segmentation problem solved? A survey of current developments and future directions
Medical image segmentation has advanced rapidly over the past two decades, largely driven by deep learning, which has enabled accurate and efficient delineation of cells, tissues, organs, and pathologies across diverse i…
Medical Image SegmentationTransfer LearningDomain AdaptationSMAFormer: Synergistic Multi-Attention Transformer for Medical Image Segmentation
In medical image segmentation, specialized computer vision techniques, notably transformers grounded in attention mechanisms and residual networks employing skip connections, have been instrumental in advancing performan…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1Attention Mechanisms in Computer Vision: A Survey
Humans can naturally and effectively find salient regions in complex scenes. Motivated by this observation, attention mechanisms were introduced into computer vision with the aim of imitating this aspect of the human vis…
image-classificationImage ClassificationImage Generationobject-detection+5Studying the Effects of Self-Attention for Medical Image Analysis
When the trained physician interprets medical images, they understand the clinical importance of visual features. By applying cognitive attention, they apply greater focus onto clinically relevant regions while disregard…
Medical Image Analysis