paper-with-me

홈 › Papers

Continually Evolved Multimodal Foundation Models for Cancer Prognosis

2025-01-30 · Jie Peng, Shuang Zhou, Longwei Yang, Yiran Song, Mohan Zhang, Kaixiong Zhou, Feng Xie, Mingquan Lin, Rui Zhang, Tianlong Chen

Cancer prognosis is a critical task that involves predicting patient outcomes and survival rates. To enhance prediction accuracy, previous studies have integrated diverse data modalities, such as clinical notes, medical images, and genomic data, leveraging their complementary information. However, existing approaches face two major limitations. First, they struggle to incorporate newly arrived data with varying distributions into training, such as patient records from different hospitals, thus rendering sub-optimal generalizability and limited utility in real-world applications. Second, most multimodal integration methods rely on simplistic concatenation or task-specific pipelines, which fail to capture the complex interdependencies across modalities. To address these, we propose a continually evolving multi-modal foundation model. Extensive experiments on the TCGA dataset demonstrate the effectiveness of our approach, highlighting its potential to advance cancer prognosis by enabling robust and adaptive multimodal integration.

📄 PDF Abstract BibTeX arXiv:2501.18170

Code (0)

등록된 구현이 없습니다.

Tasks

Predicting Patient OutcomesPrognosis

Similar Papers 제목 키워드 기반

A Multimodal Foundation Model to Enhance Generalizability and Data Efficiency for Pan-cancer Prognosis Prediction

2025-09-16 · Huajun Zhou, Fengtao Zhou, Jiabo Ma, Yingxue Xu 외 arxiv

Multimodal data provides heterogeneous information for a holistic understanding of the tumor microenvironment. However, existing AI models often struggle to harness the rich information within multimodal data and extract…

Single Domain Generalization for Multimodal Cross-Cancer Prognosis via Dirac Rebalancer and Distribution Entanglement

2025-07-11 · Jia-Xuan Jiang, Jiashuai Liu, Hongtao Wu, Yifeng Wu 외 arxiv

Deep learning has shown remarkable performance in integrating multimodal data for survival prediction. However, existing multimodal methods mainly focus on single cancer types and overlook the challenge of generalization…

Domain Generalization

CT-CLIP Representations for Multimodal Lung Cancer Survival Prediction

2026-07-09 · Sofie Allgöwer, Mikael Johansson, Andreas Hallqvist, Jonas Andersson 외 arxiv

Accurate prognosis prediction is important for treatment planning in lung cancer, but deep learning-driven survival modelling is often limited by the scarcity of curated imaging cohorts with reliable outcome data. This s…

Multimodal Whole Slide Foundation Model for Pathology

2024-11-29 · Tong Ding, Sophia J. Wagner, Andrew H. Song, Richard J. Chen 외

The field of computational pathology has been transformed with recent advances in foundation models that encode histopathology region-of-interests (ROIs) into versatile and transferable feature representations via self-s…

Cross-Modal RetrievalmodelPrognosisRetrieval+3

Cross-modality Attention-based Multimodal Fusion for Non-small Cell Lung Cancer (NSCLC) Patient Survival Prediction

2023-08-18 · Ruining Deng, Nazim Shaikh, Gareth Shannon, Yao Nie

Cancer prognosis and survival outcome predictions are crucial for therapeutic response estimation and for stratifying patients into various treatment groups. Medical domains concerned with cancer prognosis are abundant w…

PrognosisSurvival Prediction