Integrating Physiological Time Series and Clinical Notes with Transformer for Early Prediction of Sepsis

2022-03-28 · Yuqing Wang, Yun Zhao, Rachael Callcut, Linda Petzold

Sepsis is a leading cause of death in the Intensive Care Units (ICU). Early detection of sepsis is critical for patient survival. In this paper, we propose a multimodal Transformer model for early sepsis prediction, using the physiological time series data and clinical notes for each patient within $36$ hours of ICU admission. Specifically, we aim to predict sepsis using only the first 12, 18, 24, 30 and 36 hours of laboratory measurements, vital signs, patient demographics, and clinical notes. We evaluate our model on two large critical care datasets: MIMIC-III and eICU-CRD. The proposed method is compared with six baselines. In addition, ablation analysis and case studies are conducted to study the influence of each individual component of the model and the contribution of each data modality for early sepsis prediction. Experimental results demonstrate the effectiveness of our method, which outperforms competitive baselines on all metrics.

📄 PDF Abstract BibTeX arXiv:2203.14469

Code (0)

등록된 구현이 없습니다.

Tasks

ICU AdmissionTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Adam 설명 없음

Residual Connection 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Position-Wise Feed-Forward Layer 설명 없음

Integrating Physiological Time Series and Clinical Notes with Deep Learning for Improved ICU Mortality Prediction

2020-03-24 · Satya Narayan Shukla, Benjamin M. Marlin

Intensive Care Unit Electronic Health Records (ICU EHRs) store multimodal data about patients including clinical notes, sparse and irregularly sampled physiological time series, lab results, and more. To date, most metho…

ICU Mortality Mortality Prediction Prediction Time Series+1

Enhancing In-Hospital Mortality Prediction Using Multi-Representational Learning with LLM-Generated Expert Summaries

2024-11-25 · Harshavardhan Battula, Jiacheng Liu, Jaideep Srivastava

In-hospital mortality (IHM) prediction for ICU patients is critical for timely interventions and efficient resource allocation. While structured physiological data provides quantitative insights, clinical notes offer uns…

ICU Admission Large Language Model Mortality Prediction Time Series+1

Early Prediction of Mortality in Critical Care Setting in Sepsis Patients Using Structured Features and Unstructured Clinical Notes

2021-11-09 · Jiyoung Shin, Yikuan Li, Yuan Luo

Sepsis is an important cause of mortality, especially in intensive care unit (ICU) patients. Developing novel methods to identify early mortality is critical for improving survival outcomes in sepsis patients. Using the …

Transparent Early ICU Mortality Prediction with Clinical Transformer and Per-Case Modality Attribution

2025-11-19 · Alexander Bakumenko, Janine Hoelscher, Hudson Smith arxiv

Early identification of intensive care patients at risk of in-hospital mortality enables timely intervention and efficient resource allocation. Despite high predictive performance, existing machine learning approaches la…

ICU Mortality

Integrating Text and Time-Series into (Large) Language Models to Predict Medical Outcomes

2025-09-17 · Iyadh Ben Cheikh Larbi, Ajay Madhavan Ravichandran, Aljoscha Burchardt, Roland Roller arxiv

Large language models (LLMs) excel at text generation, but their ability to handle clinical classification tasks involving structured data, such as time series, remains underexplored. In this work, we adapt instruction-t…

Text Generation