paper-with-me

홈 › Papers

A Novel Global Spatial Attention Mechanism in Convolutional Neural Network for Medical Image Classification

2020-07-31 · Linchuan Xu, Jun Huang, Atsushi Nitanda, Ryo Asaoka, Kenji Yamanishi

Spatial attention has been introduced to convolutional neural networks (CNNs) for improving both their performance and interpretability in visual tasks including image classification. The essence of the spatial attention is to learn a weight map which represents the relative importance of activations within the same layer or channel. All existing attention mechanisms are local attentions in the sense that weight maps are image-specific. However, in the medical field, there are cases that all the images should share the same weight map because the set of images record the same kind of symptom related to the same object and thereby share the same structural content. In this paper, we thus propose a novel global spatial attention mechanism in CNNs mainly for medical image classification. The global weight map is instantiated by a decision boundary between important pixels and unimportant pixels. And we propose to realize the decision boundary by a binary classifier in which the intensities of all images at a pixel are the features of the pixel. The binary classification is integrated into an image classification CNN and is to be optimized together with the CNN. Experiments on two medical image datasets and one facial expression dataset showed that with the proposed attention, not only the performance of four powerful CNNs which are GoogleNet, VGG, ResNet, and DenseNet can be improved, but also meaningful attended regions can be obtained, which is beneficial for understanding the content of images of a domain.

📄 PDF Abstract BibTeX arXiv:2007.15897

Code (0)

등록된 구현이 없습니다.

Tasks

Binary ClassificationClassificationGeneral Classificationimage-classificationImage ClassificationMedical Image Classification

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Dense Block A Dense Block is a module used in convolutional neural networks that connects *all layers* (with matching feature-map sizes) directly with each other. It was originally…
Average Pooling 설명 없음
Residual Connection 설명 없음
Batch Normalization 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…

Similar Papers 제목 키워드 기반

SMTF: Sparse transformer with multiscale contextual fusion for medical image segmentation

2024-03-24 · 0324 2024 3 · ZhangXiChu

Medical image segmentation aims at recognizing the object of interest from surrounding tissues and structures, which is essential for the reliable diagnosis and morphological analysis of specific lesions. Automatic medic…

Image SegmentationMedical Image SegmentationMorphological AnalysisSegmentation+1

Global Attention Mechanism: Retain Information to Enhance Channel-Spatial Interactions

2021-12-10 · Yichao Liu, Zongru Shao, Nico Hoffmann

A variety of attention mechanisms have been studied to improve the performance of various computer vision tasks. However, the prior methods overlooked the significance of retaining the information on both channel and spa…

image-classificationImage Classification

CS2-Net: Deep Learning Segmentation of Curvilinear Structures in Medical Imaging

2020-10-15 · Lei Mou, Yitian Zhao, Huazhu Fu, Yonghuai Liu 외

Automated detection of curvilinear structures, e.g., blood vessels or nerve fibres, from medical and biomedical images is a crucial early step in automatic image interpretation associated to the management of many diseas…

DecoderDeep LearningManagementSegmentation

Multi-dimension Transformer with Attention-based Filtering for Medical Image Segmentation

2024-05-20 · Wentao Wang, Xi Xiao, Mingjie Liu, Qing Tian 외

The accurate segmentation of medical images is crucial for diagnosing and treating diseases. Recent studies demonstrate that vision transformer-based methods have significantly improved performance in medical image segme…

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

nnFormer: Interleaved Transformer for Volumetric Segmentation

2021-09-07 · Hong-Yu Zhou, Jiansen Guo, Yinghao Zhang, Lequan Yu 외

Transformer, the model of choice for natural language processing, has drawn scant attention from the medical imaging community. Given the ability to exploit long-term dependencies, transformers are promising to help atyp…

Image SegmentationInductive BiasMedical Image SegmentationSegmentation+2