paper-with-me

홈 › Papers

A Progressive Single-Modality to Multi-Modality Classification Framework for Alzheimer's Disease Sub-type Diagnosis

2024-07-26 · Yuxiao Liu, Mianxin Liu, Yuanwang Zhang, Kaicong Sun, Dinggang Shen

The current clinical diagnosis framework of Alzheimer's disease (AD) involves multiple modalities acquired from multiple diagnosis stages, each with distinct usage and cost. Previous AD diagnosis research has predominantly focused on how to directly fuse multiple modalities for an end-to-end one-stage diagnosis, which practically requires a high cost in data acquisition. Moreover, a significant part of these methods diagnose AD without considering clinical guideline and cannot offer accurate sub-type diagnosis. In this paper, by exploring inter-correlation among multiple modalities, we propose a novel progressive AD sub-type diagnosis framework, aiming to give diagnosis results based on easier-to-access modalities in earlier low-cost stages, instead of modalities from all stages. Specifically, first, we design 1) a text disentanglement network for better processing tabular data collected in the initial stage, and 2) a modality fusion module for fusing multi-modality features separately. Second, we align features from modalities acquired in earlier low-cost stage(s) with later high-cost stage(s) to give accurate diagnosis without actual modality acquisition in later-stage(s) for saving cost. Furthermore, we follow the clinical guideline to align features at each stage for achieving sub-type diagnosis. Third, we leverage a progressive classifier that can progressively include additional acquired modalities (if needed) for diagnosis, to achieve the balance between diagnosis cost and diagnosis performance. We evaluate our proposed framework on large diverse public and in-home datasets (8280 in total) and achieve superior performance over state-of-the-art methods. Our codes will be released after the acceptance.

📄 PDF Abstract BibTeX arXiv:2407.18466

Code (0)

등록된 구현이 없습니다.

Tasks

Disentanglement

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

X-PCR: A Benchmark for Cross-modality Progressive Clinical Reasoning in Ophthalmic Diagnosis

2026-04-22 · Gui Wang, Zehao Zhong, YongSong Zhou, Yudong Li 외 arxiv

Despite significant progress in Multi-modal Large Language Models (MLLMs), their clinical reasoning capacity for multi-modal diagnosis remains largely unexamined. Current benchmarks, mostly single-modality data, can't ev…

Image Quality Assessment

RGBT Tracking via Progressive Fusion Transformer with Dynamically Guided Learning

2023-03-26 · Yabin Zhu, Chenglong Li, Xiao Wang, Jin Tang 외

Existing Transformer-based RGBT tracking methods either use cross-attention to fuse the two modalities, or use self-attention and cross-attention to model both modality-specific and modality-sharing information. However,…

Learning Progressive Adaptation for Multi-Modal Tracking

2026-03-22 · He Wang, Tianyang Xu, Zhangyong Tang, Xiao-Jun Wu 외 arxiv

Due to the limited availability of paired multi-modal data, multi-modal trackers are typically built by adopting pre-trained RGB models with parameter-efficient fine-tuning modules. However, these fine-tuning methods ove…

parameter-efficient fine-tuning

DOD-SA: Infrared-Visible Decoupled Object Detection with Single-Modality Annotations

2025-08-14 · Hang Jin, Chenqiang Gao, Junjie Guo, Fangcen Liu 외 arxiv

Infrared-visible object detection has shown great potential in real-world applications, enabling robust all-day perception by leveraging the complementary information of infrared and visible images. However, existing met…

Object Detection

Multimodal Medical Endoscopic Image Analysis via Progressive Disentangle-aware Contrastive Learning

2025-08-23 · Junhao Wu, Yun Li, Junhao Li, Jingliang Bian 외 arxiv

Accurate segmentation of laryngo-pharyngeal tumors is crucial for precise diagnosis and effective treatment planning. However, traditional single-modality imaging methods often fall short of capturing the complex anatomi…

Representation LearningContrastive Learning