Multi-modal Graph Fusion for Inductive Disease Classification in Incomplete Datasets
Clinical diagnostic decision making and population-based studies often rely on multi-modal data which is noisy and incomplete. Recently, several works proposed geometric deep learning approaches to solve disease classification, by modeling patients as nodes in a graph, along with graph signal processing of multi-modal features. Many of these approaches are limited by assuming modality- and feature-completeness, and by transductive inference, which requires re-training of the entire model for each new test sample. In this work, we propose a novel inductive graph-based approach that can generalize to out-of-sample patients, despite missing features from entire modalities per patient. We propose multi-modal graph fusion which is trained end-to-end towards node-level classification. We demonstrate the fundamental working principle of this method on a simplified MNIST toy dataset. In experiments on medical data, our method outperforms single static graph approach in multi-modal disease classification.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDecision MakingDiagnosticGeneral ClassificationSimilar Papers 제목 키워드 기반
Multi-modal Graph Learning for Disease Prediction
Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix amon…
Disease PredictionGraph LearningGraph Representation LearningInductive Learning+2Adaptive Image-Feature Learning for Disease Classification Using Inductive Graph Networks
Recently, Geometric Deep Learning (GDL) has been introduced as a novel and versatile framework for computer-aided disease classification. GDL uses patient meta-information such as age and gender to model patient cohort r…
ClassificationGeneral ClassificationMulti-modal Graph Learning for Disease Prediction
Benefiting from the powerful expressive capability of graphs, graph-based approaches have been popularly applied to handle multi-modal medical data and achieved impressive performance in various biomedical applications. …
Disease PredictionGraph LearningGraph Representation LearningInductive Learning+2Multimodal Representations Learning and Adversarial Hypergraph Fusion for Early Alzheimer's Disease Prediction
Multimodal neuroimage can provide complementary information about the dementia, but small size of complete multimodal data limits the ability in representation learning. Moreover, the data distribution inconsistency from…
Alzheimer's Disease DetectionDisease PredictionRepresentation LearningFusing Modalities by Multiplexed Graph Neural Networks for Outcome Prediction in Tuberculosis
In a complex disease such as tuberculosis, the evidence for the disease and its evolution may be present in multiple modalities such as clinical, genomic, or imaging data. Effective patient-tailored outcome prediction an…
AllGraph Neural NetworkPrediction