paper-with-me

Papers

Vision Mamba: Cutting-Edge Classification of Alzheimer's Disease with 3D MRI Scans

2024-06-09 · Muthukumar K A, Amit Gurung, Priya Ranjan

Classifying 3D MRI images for early detection of Alzheimer's disease is a critical task in medical imaging. Traditional approaches using Convolutional Neural Networks (CNNs) and Transformers face significant challenges in this domain. CNNs, while effective in capturing local spatial features, struggle with long-range dependencies and often require extensive computational resources for high-resolution 3D data. Transformers, on the other hand, excel in capturing global context but suffer from quadratic complexity in inference time and require substantial memory, making them less efficient for large-scale 3D MRI data. To address these limitations, we propose the use of Vision Mamba, an advanced model based on State Space Models (SSMs), for the classification of 3D MRI images to detect Alzheimer's disease. Vision Mamba leverages dynamic state representations and the selective scan algorithm, allowing it to efficiently capture and retain important spatial information across 3D volumes. By dynamically adjusting state transitions based on input features, Vision Mamba can selectively retain relevant information, leading to more accurate and computationally efficient processing of 3D MRI data. Our approach combines the parallelizable nature of convolutional operations during training with the efficient, recurrent processing of states during inference. This architecture not only improves computational efficiency but also enhances the model's ability to handle long-range dependencies within 3D medical images. Experimental results demonstrate that Vision Mamba outperforms traditional CNN and Transformer models accuracy, making it a promising tool for the early detection of Alzheimer's disease using 3D MRI data.

📄 PDF Abstract BibTeX arXiv:2406.05757

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyEdge ClassificationMambaState Space Models

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

SITSMamba for Crop Classification based on Satellite Image Time Series

2024-09-15 · Xiaolei Qin, Xin Su, Liangpei Zhang

Satellite image time series (SITS) data provides continuous observations over time, allowing for the tracking of vegetation changes and growth patterns throughout the seasons and years. Numerous deep learning (DL) approa…

ClassificationCrop ClassificationMambaTime Series

Vision Mamba Distillation for Low-resolution Fine-grained Image Classification

2024-11-27 · Yao Chen, Jiabao Wang, Peichao Wang, Rui Zhang 외

Low-resolution fine-grained image classification has recently made significant progress, largely thanks to the super-resolution techniques and knowledge distillation methods. However, these approaches lead to an exponent…

ClassificationFine-Grained Image Classificationimage-classificationImage Classification+3

Weak-Mamba-UNet: Visual Mamba Makes CNN and ViT Work Better for Scribble-based Medical Image Segmentation

2024-02-16 · Ziyang Wang, Chao Ma

Medical image segmentation is increasingly reliant on deep learning techniques, yet the promising performance often come with high annotation costs. This paper introduces Weak-Mamba-UNet, an innovative weakly-supervised …

Cardiac SegmentationDecoderImage SegmentationMamba+4

MambaRecon: MRI Reconstruction with Structured State Space Models

2024-09-19 · Yilmaz Korkmaz, Vishal M. Patel

Magnetic Resonance Imaging (MRI) is one of the most important medical imaging modalities as it provides superior resolution of soft tissues, albeit with a notable limitation in scanning speed. The advent of deep learning…

MambaMRI ReconstructionState Space Models

Matten: Video Generation with Mamba-Attention

2024-05-05 · Yu Gao, Jiancheng Huang, Xiaopeng Sun, Zequn Jie 외

In this paper, we introduce Matten, a cutting-edge latent diffusion model with Mamba-Attention architecture for video generation. With minimal computational cost, Matten employs spatial-temporal attention for local video…

MambaVideo Generation