Embedding-based Multimodal Learning on Pan-Squamous Cell Carcinomas for Improved Survival Outcomes
Cancer clinics capture disease data at various scales, from genetic to organ level. Current bioinformatic methods struggle to handle the heterogeneous nature of this data, especially with missing modalities. We propose PARADIGM, a Graph Neural Network (GNN) framework that learns from multimodal, heterogeneous datasets to improve clinical outcome prediction. PARADIGM generates embeddings from multi-resolution data using foundation models, aggregates them into patient-level representations, fuses them into a unified graph, and enhances performance for tasks like survival analysis. We train GNNs on pan-Squamous Cell Carcinomas and validate our approach on Moffitt Cancer Center lung SCC data. Multimodal GNN outperforms other models in patient survival prediction. Converging individual data modalities across varying scales provides a more insightful disease view. Our solution aims to understand the patient's circumstances comprehensively, offering insights on heterogeneous data integration and the benefits of converging maximum data views.
Code (0)
등록된 구현이 없습니다.
Tasks
Data IntegrationGraph Neural NetworkSurvival AnalysisSurvival PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Convolution Neural Networks for diagnosing colon and lung cancer histopathological images
Lung and Colon cancer are one of the leading causes of mortality and morbidity in adults. Histopathological diagnosis is one of the key components to discern cancer type. The aim of the present research is to propose a c…
DiagnosticPatch-based Carcinoma Detection on Confocal Laser Endomicroscopy Images -- A Cross-Site Robustness Assessment
Deep learning technologies such as convolutional neural networks (CNN) provide powerful methods for image recognition and have recently been employed in the field of automated carcinoma detection in confocal laser endomi…
Searching beyond the usual papillomavirus suspects in squamous carcinomas of the vulva, penis and head and neck
Human Papillomaviruses (HPVs) are involved in the etiology of anogenital and head and neck cancers. The HPV DNA prevalence greatly differs by anatomical site. Indeed, the high rates of viral DNA prevalence in anal and ce…
Cervical Glandular Cell Detection from Whole Slide Image with Out-Of-Distribution Data
Cervical glandular cell (GC) detection is a key step in computer-aided diagnosis for cervical adenocarcinomas screening. It is challenging to accurately recognize GCs in cervical smears in which squamous cells are the ma…
Cell Detectionobject-detectionObject DetectionMethodology for Creating a Clinically Verified Dermoscopic Image Dataset
This study presents a methodology for constructing a clinically verified dataset of dermatoscopic images for medical informatics research. The relevance of the work is driven by the fact that the performance of automated…