paper-with-me

Papers

Scaling Electronic Health Record Foundation Models for Population Health Management

2025-05-30 · Liwen Sun, Hao-Ren Yao, Ophir Frieder, Xiang Qian, Chenyan Xiong arxiv

Population health management requires scalable methods to identify individuals at risk of chronic diseases such as cardiovascular conditions and cancer, yet existing approaches rely on fragmented data and resource-intensive screening. We present Scaling Electronic Health Record Foundation Models for Population Health Management, an Electronic Health Record Foundation Model that performs large-scale chronic disease prediction using cross-site longitudinal medical records. We pretrain Scaling Electronic Health Record Foundation Models for Population Health Management on billions of medical events from over 5 million patients across Taiwan and the United States, leveraging a unified code alignment framework to address cross-system heterogeneity, and characterize its scaling behavior via IsoFLOP analysis, training compute-optimal models up to 2.4B parameters. Across 11 chronic disease prediction tasks, Scaling Electronic Health Record Foundation Models for Population Health Management demonstrates strong scaling and generalization, outperforming tree-based models and both general and biomedical language models, achieving over 40% and 70% sensitivity at 99% specificity in U.S. and Taiwan cohorts, respectively. On the EHRShot benchmark, Scaling Electronic Health Record Foundation Models for Population Health Management surpasses prior EHR foundation models trained on in-site data despite substantial distribution shifts, highlighting strong few-shot generalization. Finally, we show that aligned cross-system data provides more effective pretraining signal than duplicating single-site data under data-limited settings, underscoring the importance of alignment for scalable healthcare modeling. Our analysis demonstrates the robustness of EHR-FM in various patient distributions and the benefits of operating in the ICD code space. The code will be open-sourced.

📄 PDF Abstract BibTeX arXiv:2506.00209

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

FoMoH: A clinically meaningful foundation model evaluation for structured electronic health records

2025-05-22 · Chao Pang, Vincent Jeanselme, Young Sang Choi, Xinzhuo Jiang 외

Foundation models hold significant promise in healthcare, given their capacity to extract meaningful representations independent of downstream tasks. This property has enabled state-of-the-art performance across several …

Learning Longitudinal Health Representations from EHR and Wearable Data

2026-01-18 · Yuanyun Zhang, Han Zhou, Li Feng, Yilin Hong 외 arxiv

Foundation models trained on electronic health records show strong performance on many clinical prediction tasks but are limited by sparse and irregular documentation. Wearable devices provide dense continuous physiologi…

Exploring Scaling Laws for EHR Foundation Models

2025-05-29 · Sheng Zhang, Qin Liu, Naoto Usuyama, Cliff Wong 외

The emergence of scaling laws has profoundly shaped the development of large language models (LLMs), enabling predictable performance gains through systematic increases in model size, dataset volume, and compute. Yet, th…

Demographical Priors for Health Conditions Diagnosis Using Medicare Data

2016-12-07 · Fahad Alhasoun, May Alhazzani, Marta C. González

This paper presents an example of how demographical characteristics of patients influence their susceptibility to certain medical conditions. In this paper, we investigate the association of health conditions to age of p…

Diagnostic

Mining Electronic Health Records: A Survey

2017-02-09 · Pranjul Yadav, Michael Steinbach, Vipin Kumar, Gyorgy Simon

The continuously increasing cost of the US healthcare system has received significant attention. Central to the ideas aimed at curbing this trend is the use of technology, in the form of the mandate to implement electron…

ManagementPrognosisSurvey