paper-with-me

Papers

VM-UNET-V2 Rethinking Vision Mamba UNet for Medical Image Segmentation

2024-03-14 · Mingya Zhang, Yue Yu, Limei Gu, Tingsheng Lin, Xianping Tao

In the field of medical image segmentation, models based on both CNN and Transformer have been thoroughly investigated. However, CNNs have limited modeling capabilities for long-range dependencies, making it challenging to exploit the semantic information within images fully. On the other hand, the quadratic computational complexity poses a challenge for Transformers. Recently, State Space Models (SSMs), such as Mamba, have been recognized as a promising method. They not only demonstrate superior performance in modeling long-range interactions, but also preserve a linear computational complexity. Inspired by the Mamba architecture, We proposed Vison Mamba-UNetV2, the Visual State Space (VSS) Block is introduced to capture extensive contextual information, the Semantics and Detail Infusion (SDI) is introduced to augment the infusion of low-level and high-level features. We conduct comprehensive experiments on the ISIC17, ISIC18, CVC-300, CVC-ClinicDB, Kvasir, CVC-ColonDB and ETIS-LaribPolypDB public datasets. The results indicate that VM-UNetV2 exhibits competitive performance in medical image segmentation tasks. Our code is available at https://github.com/nobodyplayer1/VM-UNetV2.

📄 PDF Abstract BibTeX arXiv:2403.09157

Code (1)

nobodyplayer1/vm-unetv2 공식 구현 pytorch

Tasks

Image SegmentationMambaMedical Image SegmentationSemantic SegmentationState Space Models

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation

2024-03-08 · Weibin Liao, Yinghao Zhu, Xinyuan Wang, Chengwei Pan 외

UNet and its variants have been widely used in medical image segmentation. However, these models, especially those based on Transformer architectures, pose challenges due to their large number of parameters and computati…

Image SegmentationMambaMedical Image SegmentationSemantic Segmentation+1

ViM-UNet: Vision Mamba for Biomedical Segmentation

2024-04-11 · Anwai Archit, Constantin Pape

CNNs, most notably the UNet, are the default architecture for biomedical segmentation. Transformer-based approaches, such as UNETR, have been proposed to replace them, benefiting from a global field of view, but sufferin…

Instance SegmentationMambaSegmentationSemantic Segmentation

Weak-Mamba-UNet: Visual Mamba Makes CNN and ViT Work Better for Scribble-based Medical Image Segmentation

2024-02-16 · Ziyang Wang, Chao Ma

Medical image segmentation is increasingly reliant on deep learning techniques, yet the promising performance often come with high annotation costs. This paper introduces Weak-Mamba-UNet, an innovative weakly-supervised …

Cardiac SegmentationDecoderImage SegmentationMamba+4

LKM-UNet: Large Kernel Vision Mamba UNet for Medical Image Segmentation

2024-03-12 · Jinhong Wang, Jintai Chen, Danny Chen, Jian Wu

In clinical practice, medical image segmentation provides useful information on the contours and dimensions of target organs or tissues, facilitating improved diagnosis, analysis, and treatment. In the past few years, co…

Image SegmentationLong-range modelingMambaMedical Image Segmentation+1

Mamba-UNet: UNet-Like Pure Visual Mamba for Medical Image Segmentation

2024-02-07 · Ziyang Wang, Jian-Qing Zheng, Yichi Zhang, Ge Cui 외

In recent advancements in medical image analysis, Convolutional Neural Networks (CNN) and Vision Transformers (ViT) have set significant benchmarks. While the former excels in capturing local features through its convolu…

Cardiac SegmentationComputational EfficiencyDecoderImage Segmentation+5