Leveraging Clinical Time-Series Data for Prediction: A Cautionary Tale
In healthcare, patient risk stratification models are often learned using time-series data extracted from electronic health records. When extracting data for a clinical prediction task, several formulations exist, depending on how one chooses the time of prediction and the prediction horizon. In this paper, we show how the formulation can greatly impact both model performance and clinical utility. Leveraging a publicly available ICU dataset, we consider two clinical prediction tasks: in-hospital mortality, and hypokalemia. Through these case studies, we demonstrate the necessity of evaluating models using an outcome-independent reference point, since choosing the time of prediction relative to the event can result in unrealistic performance. Further, an outcome-independent scheme outperforms an outcome-dependent scheme on both tasks (In-Hospital Mortality AUROC .882 vs. .831; Serum Potassium: AUROC .829 vs. .740) when evaluated on test sets that mimic real-world use.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Improving Clinical Predictions through Unsupervised Time Series Representation Learning
In this work, we investigate unsupervised representation learning on medical time series, which bears the promise of leveraging copious amounts of existing unlabeled data in order to eventually assist clinical decision m…
Decision MakingRepresentation LearningTime SeriesTime Series AnalysisEnhancing In-Hospital Mortality Prediction Using Multi-Representational Learning with LLM-Generated Expert Summaries
In-hospital mortality (IHM) prediction for ICU patients is critical for timely interventions and efficient resource allocation. While structured physiological data provides quantitative insights, clinical notes offer uns…
ICU AdmissionLarge Language ModelMortality PredictionTime Series+1Incorporating Metabolic Information into LLMs for Anomaly Detection in Clinical Time-Series
Anomaly detection in clinical time-series holds significant potential in identifying suspicious patterns in different biological parameters. In this paper, we propose a targeted method that incorporates the clinical doma…
Anomaly DetectionTime SeriesDynamic feature selection in medical predictive monitoring by reinforcement learning
In this paper, we investigate dynamic feature selection within multivariate time-series scenario, a common occurrence in clinical prediction monitoring where each feature corresponds to a bio-test result. Many existing f…
feature selectionPredictionreinforcement-learningReinforcement Learning+1Transfer Learning for Clinical Time Series Analysis using Deep Neural Networks
Deep neural networks have shown promising results for various clinical prediction tasks. However, training deep networks such as those based on Recurrent Neural Networks (RNNs) requires large labeled data, significant hy…
Domain AdaptationTime SeriesTime Series AnalysisTransfer Learning