paper-with-me

Papers

GFE-Mamba: Mamba-based AD Multi-modal Progression Assessment via Generative Feature Extraction from MCI

2024-07-22 · Zhaojie Fang, Shenghao Zhu, Yifei Chen, Binfeng Zou, Fan Jia, Chang Liu, Xiang Feng, Linwei Qiu, Feiwei Qin, Jin Fan, Changbiao Chu, Changmiao Wang

Alzheimer's Disease (AD) is a progressive, irreversible neurodegenerative disorder that often originates from Mild Cognitive Impairment (MCI). This progression results in significant memory loss and severely affects patients' quality of life. Clinical trials have consistently shown that early and targeted interventions for individuals with MCI may slow or even prevent the advancement of AD. Research indicates that accurate medical classification requires diverse multimodal data, including detailed assessment scales and neuroimaging techniques like Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET). However, simultaneously collecting the aforementioned three modalities for training presents substantial challenges. To tackle these difficulties, we propose GFE-Mamba, a multimodal classifier founded on Generative Feature Extractor. The intermediate features provided by this Extractor can compensate for the shortcomings of PET and achieve profound multimodal fusion in the classifier. The Mamba block, as the backbone of the classifier, enables it to efficiently extract information from long-sequence scale information. Pixel-level Bi-cross Attention supplements pixel-level information from MRI and PET. We provide our rationale for developing this cross-temporal progression prediction dataset and the pre-trained Extractor weights. Our experimental findings reveal that the GFE-Mamba model effectively predicts the progression from MCI to AD and surpasses several leading methods in the field. Our source code is available at https://github.com/Tinysqua/GFE-Mamba.

📄 PDF Abstract BibTeX arXiv:2407.15719

Code (1)

tinysqua/gfe-mamba 공식 구현 pytorch

Tasks

Mamba

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Mamba Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module.…

Similar Papers 제목 키워드 기반

AMD-Mamba: A Phenotype-Aware Multi-Modal Framework for Robust AMD Prognosis

2025-08-04 · Puzhen Wu, Mingquan Lin, Qingyu Chen, Emily Y. Chew 외 arxiv

Age-related macular degeneration (AMD) is a leading cause of irreversible vision loss, making effective prognosis crucial for timely intervention. In this work, we propose AMD-Mamba, a novel multi-modal framework for AMD…

Metric Learning

UltraLight Med-Vision Mamba for Classification of Neoplastic Progression in Tubular Adenomas

2025-08-12 · Aqsa Sultana, Nordin Abouzahra, Ahmed Rahu, Brian Shula 외 arxiv

Identification of precancerous polyps during routine colonoscopy screenings is vital for their excision, lowering the risk of developing colorectal cancer. Advanced deep learning algorithms enable precise adenoma classif…

OmniMamba4D: Spatio-temporal Mamba for longitudinal CT lesion segmentation

2025-04-13 · Justin Namuk Kim, Yiqiao Liu, Rajath Soans, Keith Persson 외

Accurate segmentation of longitudinal CT scans is important for monitoring tumor progression and evaluating treatment responses. However, existing 3D segmentation models solely focus on spatial information. To address th…

Computational EfficiencyLesion SegmentationMambaSegmentation

DA-Mamba: Dialogue-aware selective state-space model for multimodal engagement estimation

2025-09-22 · Shenwei Kang, Xin Zhang, Wen Liu, Bin Li 외 arxiv

Human engagement estimation in conversational scenarios is essential for applications such as adaptive tutoring, remote healthcare assessment, and socially aware human--computer interaction. Engagement is a dynamic, mult…

A Mamba-Based Multimodal Network for Multiscale Blast-Induced Rapid Structural Damage Assessment

2026-04-13 · Wanli Ma, Sivasakthy Selvakumaran, Dain G. Farrimond, Adam A. Dennis 외 arxiv

Accurate and rapid structural damage assessment (SDA) is crucial for post-disaster management, helping responders prioritise resources, plan rescues, and support recovery. Traditional field inspections, though precise, a…