paper-with-me

Papers

DuAT: Dual-Aggregation Transformer Network for Medical Image Segmentation

2022-12-21 · Feilong Tang, Qiming Huang, Jinfeng Wang, Xianxu Hou, Jionglong Su, Jingxin Liu

Transformer-based models have been widely demonstrated to be successful in computer vision tasks by modelling long-range dependencies and capturing global representations. However, they are often dominated by features of large patterns leading to the loss of local details (e.g., boundaries and small objects), which are critical in medical image segmentation. To alleviate this problem, we propose a Dual-Aggregation Transformer Network called DuAT, which is characterized by two innovative designs, namely, the Global-to-Local Spatial Aggregation (GLSA) and Selective Boundary Aggregation (SBA) modules. The GLSA has the ability to aggregate and represent both global and local spatial features, which are beneficial for locating large and small objects, respectively. The SBA module is used to aggregate the boundary characteristic from low-level features and semantic information from high-level features for better preserving boundary details and locating the re-calibration objects. Extensive experiments in six benchmark datasets demonstrate that our proposed model outperforms state-of-the-art methods in the segmentation of skin lesion images, and polyps in colonoscopy images. In addition, our approach is more robust than existing methods in various challenging situations such as small object segmentation and ambiguous object boundaries.

📄 PDF Abstract BibTeX arXiv:2212.11677

Code (1)

Barrett-python/DuAT 공식 구현 pytorch

Tasks

Image SegmentationLesion SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Multi-scale Hierarchical Vision Transformer with Cascaded Attention Decoding for Medical Image Segmentation

2023-03-29 · Md Mostafijur Rahman, Radu Marculescu

Transformers have shown great success in medical image segmentation. However, transformers may exhibit a limited generalization ability due to the underlying single-scale self-attention (SA) mechanism. In this paper, we …

DecoderImage SegmentationMedical Image SegmentationSegmentation+1

DR$\vert$GRADUATE: uncertainty-aware deep learning-based diabetic retinopathy grading in eye fundus images

2019-10-25 · Teresa Araújo, Guilherme Aresta, Luís Mendonça, Susana Penas 외

Diabetic retinopathy (DR) grading is crucial in determining the adequate treatment and follow up of patients, but the screening process can be tiresome and prone to errors. Deep learning approaches have shown promising p…

Diabetic Retinopathy GradingMultiple Instance LearningOutlier Detection

Dual Aggregation Transformer for Image Super-Resolution

2023-08-07 · ICCV 2023 1 · Zheng Chen, Yulun Zhang, Jinjin Gu, Linghe Kong 외

Transformer has recently gained considerable popularity in low-level vision tasks, including image super-resolution (SR). These networks utilize self-attention along different dimensions, spatial or channel, and achieve …

Image Super-ResolutionSuper-Resolution

Evaluating multiple large language models in pediatric ophthalmology

2023-11-07 · Jason Holmes, Rui Peng, Yiwei Li, Jinyu Hu 외

IMPORTANCE The response effectiveness of different large language models (LLMs) and various individuals, including medical students, graduate students, and practicing physicians, in pediatric ophthalmology consultations,…

Multiple-choice

Enhancing Medical Image Segmentation with TransCeption: A Multi-Scale Feature Fusion Approach

2023-01-25 · Reza Azad, Yiwei Jia, Ehsan Khodapanah Aghdam, Julien Cohen-Adad 외

While CNN-based methods have been the cornerstone of medical image segmentation due to their promising performance and robustness, they suffer from limitations in capturing long-range dependencies. Transformer-based appr…

Image SegmentationLesion SegmentationMedical Image SegmentationSegmentation+2