ViTBIS: Vision Transformer for Biomedical Image Segmentation
In this paper, we propose a novel network named Vision Transformer for Biomedical Image Segmentation (ViTBIS). Our network splits the input feature maps into three parts with $1\times 1$, $3\times 3$ and $5\times 5$ convolutions in both encoder and decoder. Concat operator is used to merge the features before being fed to three consecutive transformer blocks with attention mechanism embedded inside it. Skip connections are used to connect encoder and decoder transformer blocks. Similarly, transformer blocks and multi scale architecture is used in decoder before being linearly projected to produce the output segmentation map. We test the performance of our network using Synapse multi-organ segmentation dataset, Automated cardiac diagnosis challenge dataset, Brain tumour MRI segmentation dataset and Spleen CT segmentation dataset. Without bells and whistles, our network outperforms most of the previous state of the art CNN and transformer based models using Dice score and the Hausdorff distance as the evaluation metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderImage SegmentationMRI segmentationOrgan SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
xLSTM-UNet can be an Effective 2D & 3D Medical Image Segmentation Backbone with Vision-LSTM (ViL) better than its Mamba Counterpart
Convolutional Neural Networks (CNNs) and Vision Transformers (ViT) have been pivotal in biomedical image segmentation, yet their ability to manage long-range dependencies remains constrained by inherent locality and comp…
3D Medical Imaging Segmentationimage-classificationImage ClassificationImage Segmentation+5VTBIS: Vision Transformer for Biomedical Image Segmentation
In this paper, we propose a novel network named Vision Transformer for Biomedical Image Segmentation (VTBIS). Our network splits the input feature maps into three parts with 1 × 1, 3 × 3 and 5 × 5 convolutions in both en…
DecoderImage SegmentationMRI segmentationOrgan Segmentation+2Going Beyond U-Net: Assessing Vision Transformers for Semantic Segmentation in Microscopy Image Analysis
Segmentation is a crucial step in microscopy image analysis. Numerous approaches have been developed over the past years, ranging from classical segmentation algorithms to advanced deep learning models. While U-Net remai…
Image SegmentationSegmentationSemantic SegmentationA Study on Context Length and Efficient Transformers for Biomedical Image Analysis
Biomedical imaging modalities often produce high-resolution, multi-dimensional images that pose computational challenges for deep neural networks. These computational challenges are compounded when training transformers …
DenoisingMulti-Compound Transformer for Accurate Biomedical Image Segmentation
The recent vision transformer(i.e.for image classification) learns non-local attentive interaction of different patch tokens. However, prior arts miss learning the cross-scale dependencies of different pixels, the semant…
image-classificationImage ClassificationImage SegmentationSemantic correspondence+1