A Novel Global Spatial Attention Mechanism in Convolutional Neural Network for Medical Image Classification
Spatial attention has been introduced to convolutional neural networks (CNNs) for improving both their performance and interpretability in visual tasks including image classification. The essence of the spatial attention is to learn a weight map which represents the relative importance of activations within the same layer or channel. All existing attention mechanisms are local attentions in the sense that weight maps are image-specific. However, in the medical field, there are cases that all the images should share the same weight map because the set of images record the same kind of symptom related to the same object and thereby share the same structural content. In this paper, we thus propose a novel global spatial attention mechanism in CNNs mainly for medical image classification. The global weight map is instantiated by a decision boundary between important pixels and unimportant pixels. And we propose to realize the decision boundary by a binary classifier in which the intensities of all images at a pixel are the features of the pixel. The binary classification is integrated into an image classification CNN and is to be optimized together with the CNN. Experiments on two medical image datasets and one facial expression dataset showed that with the proposed attention, not only the performance of four powerful CNNs which are GoogleNet, VGG, ResNet, and DenseNet can be improved, but also meaningful attended regions can be obtained, which is beneficial for understanding the content of images of a domain.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationClassificationGeneral Classificationimage-classificationImage ClassificationMedical Image ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SMTF: Sparse transformer with multiscale contextual fusion for medical image segmentation
Medical image segmentation aims at recognizing the object of interest from surrounding tissues and structures, which is essential for the reliable diagnosis and morphological analysis of specific lesions. Automatic medic…
Image SegmentationMedical Image SegmentationMorphological AnalysisSegmentation+1Global Attention Mechanism: Retain Information to Enhance Channel-Spatial Interactions
A variety of attention mechanisms have been studied to improve the performance of various computer vision tasks. However, the prior methods overlooked the significance of retaining the information on both channel and spa…
image-classificationImage ClassificationCS2-Net: Deep Learning Segmentation of Curvilinear Structures in Medical Imaging
Automated detection of curvilinear structures, e.g., blood vessels or nerve fibres, from medical and biomedical images is a crucial early step in automatic image interpretation associated to the management of many diseas…
DecoderDeep LearningManagementSegmentationMulti-dimension Transformer with Attention-based Filtering for Medical Image Segmentation
The accurate segmentation of medical images is crucial for diagnosing and treating diseases. Recent studies demonstrate that vision transformer-based methods have significantly improved performance in medical image segme…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationnnFormer: Interleaved Transformer for Volumetric Segmentation
Transformer, the model of choice for natural language processing, has drawn scant attention from the medical imaging community. Given the ability to exploit long-term dependencies, transformers are promising to help atyp…
Image SegmentationInductive BiasMedical Image SegmentationSegmentation+2