paper-with-me

홈 › Papers

Recalibrating Fully Convolutional Networks with Spatial and Channel 'Squeeze & Excitation' Blocks

2018-08-23 · Abhijit Guha Roy, Nassir Navab, Christian Wachinger

In a wide range of semantic segmentation tasks, fully convolutional neural networks (F-CNNs) have been successfully leveraged to achieve state-of-the-art performance. Architectural innovations of F-CNNs have mainly been on improving spatial encoding or network connectivity to aid gradient flow. In this article, we aim towards an alternate direction of recalibrating the learned feature maps adaptively; boosting meaningful features while suppressing weak ones. The recalibration is achieved by simple computational blocks that can be easily integrated in F-CNNs architectures. We draw our inspiration from the recently proposed 'squeeze & excitation' (SE) modules for channel recalibration for image classification. Towards this end, we introduce three variants of SE modules for segmentation, (i) squeezing spatially and exciting channel-wise, (ii) squeezing channel-wise and exciting spatially and (iii) joint spatial and channel 'squeeze & excitation'. We effectively incorporate the proposed SE blocks in three state-of-the-art F-CNNs and demonstrate a consistent improvement of segmentation accuracy on three challenging benchmark datasets. Importantly, SE blocks only lead to a minimal increase in model complexity of about 1.5%, while the Dice score increases by 4-9% in the case of U-Net. Hence, we believe that SE blocks can be an integral part of future F-CNN architectures.

📄 PDF Abstract BibTeX arXiv:1808.08127

Code (5)

abhi4ssj/squeeze_and_excitation pytorch
ai-med/squeeze_and_excitation pytorch
highwaywu/tianchi-fft2 pytorch
ioanvl/1d_squeeze_excitation pytorch
qubvel/segmentation_models.pytorch/blob/a6e1123983548be55d4d1320e0a2f5fd9174d4ac/segmentation_models_pytorch/base/modules.py pytorch

Tasks

image-classificationImage ClassificationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

scSE To aggregate global spatial information, an SE block applies global pooling to the feature map. However, it ignores pixel-wise spatial information, which is important in dense…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Sigmoid Activation 설명 없음
Average Pooling 설명 없음
Squeeze-and-Excitation Block The Squeeze-and-Excitation Block is an architectural unit designed to improve the representational power of a network by enabling it to perform dynamic channel-wise feature…
Channel Squeeze and Spatial Excitation Inspired on the widely known spatial squeeze and channel excitation (SE) block, the sSE block performs channel…
Concurrent Spatial and Channel Squeeze & Excitation Combines the channel attention of the widely known spatial squeeze and channel excitation (SE) block and the…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…

Similar Papers 제목 키워드 기반

Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networks

2018-03-07 · Abhijit Guha Roy, Nassir Navab, Christian Wachinger

Fully convolutional neural networks (F-CNNs) have set the state-of-the-art in image segmentation for a plethora of applications. Architectural innovations within F-CNNs have mainly focused on improving spatial encoding o…

Brain Segmentationimage-classificationImage ClassificationImage Segmentation+3

Recalibrating 3D ConvNets with Project & Excite

2020-02-25 · Anne-Marie Rickmann, Abhijit Guha Roy, Ignacio Sarasua, Christian Wachinger

Fully Convolutional Neural Networks (F-CNNs) achieve state-of-the-art performance for segmentation tasks in computer vision and medical imaging. Recently, computational blocks termed squeeze and excitation (SE) have been…

Brain SegmentationSegmentation

ME-CapsNet: A Multi-Enhanced Capsule Networks with Routing Mechanism

2022-03-29 · Jerrin Bright, Suryaprakash Rajkumar, Arockia Selvakumar Arockia Doss

Convolutional Neural Networks need the construction of informative features, which are determined by channel-wise and spatial-wise information at the network's layers. In this research, we focus on bringing in a novel so…

Sound Event Detection in Multichannel Audio using Convolutional Time-Frequency-Channel Squeeze and Excitation

2019-08-04 · Wei Xia, Kazuhito Koishida

In this study, we introduce a convolutional time-frequency-channel "Squeeze and Excitation" (tfc-SE) module to explicitly model inter-dependencies between the time-frequency domain and multiple channels. The tfc-SE modul…

Event DetectionSound Event Detection

Squeeze-and-Excitation on Spatial and Temporal Deep Feature Space for Action Recognition

2018-06-02 · Gaoyun An, Wen Zhou, Yuxuan Wu, Zhenxing Zheng 외

Spatial and temporal features are two key and complementary information for human action recognition. In order to make full use of the intra-frame spatial characteristics and inter-frame temporal relationships, we propos…

Action RecognitionTemporal Action Localization