The Importance of Skip Connections in Biomedical Image Segmentation
In this paper, we study the influence of both long and short skip connections on Fully Convolutional Networks (FCN) for biomedical image segmentation. In standard FCNs, only long skip connections are used to skip features from the contracting path to the expanding path in order to recover spatial information lost during downsampling. We extend FCNs by adding short skip connections, that are similar to the ones introduced in residual networks, in order to build very deep FCNs (of hundreds of layers). A review of the gradient flow confirms that for a very deep FCN it is beneficial to have both long and short skip connections. Finally, we show that a very deep FCN can achieve near-to-state-of-the-art results on the EM dataset without any further post-processing.
Code (1)
Tasks
Image SegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Rethinking U-net Skip Connections for Biomedical Image Segmentation
The U-net architecture has significantly impacted deep learning-based segmentation of medical images. Through the integration of long-range skip connections, it facilitated the preservation of high-resolution features. O…
Image SegmentationSegmentationSemantic SegmentationACE-Net: Biomedical Image Segmentation with Augmented Contracting and Expansive Paths
Nowadays U-net-like FCNs predominate various biomedical image segmentation applications and attain promising performance, largely due to their elegant architectures, e.g., symmetric contracting and expansive paths as wel…
Image SegmentationSegmentationSemantic SegmentationGradient-Skipping Relevance Propagation for Efficient Explainability of Vision Transformers
Vision Transformers (ViTs) are difficult to interpret because current methods of relevance propagation and attention flow do not fully consider some key architectural features, such as the uneven importance of attention …
Sharp U-Net: Depthwise Convolutional Network for Biomedical Image Segmentation
The U-Net architecture, built upon the fully convolutional network, has proven to be effective in biomedical image segmentation. However, U-Net applies skip connections to merge semantically different low- and high-level…
DecoderImage SegmentationSegmentationSemantic SegmentationViTBIS: Vision Transformer for Biomedical Image Segmentation
In this paper, we propose a novel network named Vision Transformer for Biomedical Image Segmentation (ViTBIS). Our network splits the input feature maps into three parts with $1\times 1$, $3\times 3$ and $5\times 5$ conv…
DecoderImage SegmentationMRI segmentationOrgan Segmentation+2