paper-with-me

Papers

Patch-based Intuitive Multimodal Prototypes Network (PIMPNet) for Alzheimer's Disease classification

2024-07-19 · Lisa Anita De Santi, Jörg Schlötterer, Meike Nauta, Vincenzo Positano, Christin Seifert

Volumetric neuroimaging examinations like structural Magnetic Resonance Imaging (sMRI) are routinely applied to support the clinical diagnosis of dementia like Alzheimer's Disease (AD). Neuroradiologists examine 3D sMRI to detect and monitor abnormalities in brain morphology due to AD, like global and/or local brain atrophy and shape alteration of characteristic structures. There is a strong research interest in developing diagnostic systems based on Deep Learning (DL) models to analyse sMRI for AD. However, anatomical information extracted from an sMRI examination needs to be interpreted together with patient's age to distinguish AD patterns from the regular alteration due to a normal ageing process. In this context, part-prototype neural networks integrate the computational advantages of DL in an interpretable-by-design architecture and showed promising results in medical imaging applications. We present PIMPNet, the first interpretable multimodal model for 3D images and demographics applied to the binary classification of AD from 3D sMRI and patient's age. Despite age prototypes do not improve predictive performance compared to the single modality model, this lays the foundation for future work in the direction of the model's design and multimodal prototype training process

📄 PDF Abstract BibTeX arXiv:2407.14277

Code (1)

desantilisa/PIMPNet3D/blob/main/README.md 공식 구현 pytorch

Tasks

Binary ClassificationDiagnostic

Similar Papers 제목 키워드 기반

PIP-Net: Patch-Based Intuitive Prototypes for Interpretable Image Classification

2023-01-01 · CVPR 2023 1 · Meike Nauta, Jörg Schlötterer, Maurice van Keulen, Christin Seifert

Interpretable methods based on prototypical patches recognize various components in an image in order to explain their reasoning to humans. However, existing prototype-based methods can learn prototypes that are not …

Decision Makingimage-classificationImage Classification

X-SiT: Inherently Interpretable Surface Vision Transformers for Dementia Diagnosis

2025-06-25 · Fabian Bongratz, Tom Nuno Wolf, Jaume Gual Ramon, Christian Wachinger

Interpretable models are crucial for supporting clinical decision-making, driving advances in their development and application for medical images. However, the nature of 3D volumetric data makes it inherently challengin…

AnatomyDecision MakingDecoder

4D Multimodal Co-attention Fusion Network with Latent Contrastive Alignment for Alzheimer's Diagnosis

2025-04-23 · Yuxiang Wei, Yanteng Zhang, Xi Xiao, Tianyang Wang 외

Multimodal neuroimaging provides complementary structural and functional insights into both human brain organization and disease-related dynamics. Recent studies demonstrate enhanced diagnostic sensitivity for Alzheimer'…

Diagnostic

PIPNet3D: Interpretable Detection of Alzheimer in MRI Scans

2024-03-27 · Lisa Anita De Santi, Jörg Schlötterer, Michael Scheschenja, Joel Wessendorf 외

Information from neuroimaging examinations is increasingly used to support diagnoses of dementia, e.g., Alzheimer's disease. While current clinical practice is mainly based on visual inspection and feature engineering, D…

Feature Engineering

Multimodal Prototyping for cancer survival prediction

2024-06-28 · Andrew H. Song, Richard J. Chen, Guillaume Jaume, Anurag J. Vaidya 외

Multimodal survival methods combining gigapixel histology whole-slide images (WSIs) and transcriptomic profiles are particularly promising for patient prognostication and stratification. Current approaches involve tokeni…

PredictionSurvival Predictionwhole slide images