paper-with-me

홈 › Papers

NOAH: Learning the Full Patient Journey. A Longitudinal Multimodal Time-Aware Model for Representation and Forecasting

2026-09-08 · Tobias Susetzky, Raphael Rehms, Dmitrii Seletkov, Özgün Turgut, Michelle Espranita Liman, Lisa Steinhelfer, Rickmer Braren, Daniel Rueckert hf

The digitization of healthcare has generated vast, longitudinal, and multimodal patient records over a lifetime, yet fully exploiting these data to represent and predict patient state trajectories remains a critical challenge. Current AI models often struggle to capture the complex, irregular temporal dynamics and inherent stochasticity of real-world multimodal patient data. Existing AI approaches for modeling longitudinal patient records are predominantly discriminative, limited to a few modalities, constrained by closed categorical vocabularies, treating time as a monotonic inductive bias, or they are limited in forecasting future patient states. We introduce NOAH, a time-aware, task-agnostic, generative transformer model representing and forecasting the full multimodal patient journey. NOAH features a novel bidirectional time integration and a variational latent space to capture the continuous evolution of patient states and the stochasticity of clinical trajectories. Built from over 559 million clinical events from 431,000 hospital visits of 299,000 patients across the MIMIC dataset family, NOAH natively processes medical images, time-series and numeric signals, categorical events, as well as structured and unstructured clinical records. NOAH is the first truly holistic generative model in its field, enabling autoregressive forecasting with optional time control, zero-shot classification, and counterfactual intervention simulation. It generates highly informative and predictive patient state representations that demonstrate strong performance in probing for clinical outcomes, 15 ICD chapters, and 29 comorbidities, as well as in time-to-event prediction. Seamlessly handling diverse modalities and complex temporal dynamics, NOAH provides a versatile, task-agnostic, scalable foundation for intelligent predictive systems in personalized clinical care and digital medicine.

📄 PDF Abstract BibTeX arXiv:2609.09140

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Patient Similarity Analysis with Longitudinal Health Data

2020-05-14 · Ahmed Allam, Matthias Dittberner, Anna Sintsova, Dominique Brodbeck 외

Healthcare professionals have long envisioned using the enormous processing powers of computers to discover new facts and medical knowledge locked inside electronic health records. These vast medical archives contain tim…

Decision Making

A Pipeline for Generating Longitudinal Synthetic Clinical Notes Using Large Language Models

2026-06-25 · William Poulett, Alice Waterhouse, Ben Wallace, Scarlett Kynoch 외 arxiv

Synthetic data is increasingly used to enable the development and evaluation of AI systems in domains where access to real-world data is restricted. In healthcare, clinical documentation presents particular challenges du…

A multimodal and temporal foundation model for virtual patient representations at healthcare system scale

2026-04-20 · Andrew Zhang, Tong Ding, Sophia J. Wagner, Caiwei Tian 외 arxiv

Modern medicine generates vast multimodal data across siloed systems, yet no existing model integrates the full breadth and temporal depth of the clinical record into a unified patient representation. We introduce Apollo…

Semantic Similarity

LongMoE: Longitudinal Multimodal Learning via Trajectory-Aware Mixture-of-Experts

2026-06-06 · Maxx Richard Rahman, Prakhar Kumar, Wolfgang Maass arxiv

Multimodal clinical learning is increasingly important for integrating diverse patient data, including imaging, text, and personalised health records. However, it faces two fundamental challenges: i) modality missingness…

BiteNet: Bidirectional Temporal Encoder Network to Predict Medical Outcomes

2020-09-24 · Xueping Peng, Guodong Long, Tao Shen, Sen Wang 외

Electronic health records (EHRs) are longitudinal records of a patient's interactions with healthcare systems. A patient's EHR data is organized as a three-level hierarchy from top to bottom: patient journey - all the ex…

ClusteringPrediction