paper-with-me

홈 › Papers

TA-RNN: an Attention-based Time-aware Recurrent Neural Network Architecture for Electronic Health Records

2024-01-26 · Mohammad Al Olaimat, Serdar Bozdag

Motivation: Electronic Health Records (EHR) represent a comprehensive resource of a patient's medical history. EHR are essential for utilizing advanced technologies such as deep learning (DL), enabling healthcare providers to analyze extensive data, extract valuable insights, and make precise and data-driven clinical decisions. DL methods such as Recurrent Neural Networks (RNN) have been utilized to analyze EHR to model disease progression and predict diagnosis. However, these methods do not address some inherent irregularities in EHR data such as irregular time intervals between clinical visits. Furthermore, most DL models are not interpretable. In this study, we propose two interpretable DL architectures based on RNN, namely Time-Aware RNN (TA-RNN) and TA-RNN-Autoencoder (TA-RNN-AE) to predict patient's clinical outcome in EHR at next visit and multiple visits ahead, respectively. To mitigate the impact of irregular time intervals, we propose incorporating time embedding of the elapsed times between visits. For interpretability, we propose employing a dual-level attention mechanism that operates between visits and features within each visit. Results: The results of the experiments conducted on Alzheimer's Disease Neuroimaging Initiative (ADNI) and National Alzheimer's Coordinating Center (NACC) datasets indicated superior performance of proposed models for predicting Alzheimer's Disease (AD) compared to state-of-the-art and baseline approaches based on F2 and sensitivity. Additionally, TA-RNN showed superior performance on Medical Information Mart for Intensive Care (MIMIC-III) dataset for mortality prediction. In our ablation study, we observed enhanced predictive performance by incorporating time embedding and attention mechanisms. Finally, investigating attention weights helped identify influential visits and features in predictions.

📄 PDF Abstract BibTeX arXiv:2401.14694

Code (0)

등록된 구현이 없습니다.

Tasks

Mortality Prediction

Similar Papers 제목 키워드 기반

Benchmarking Deep Learning Architectures for Predicting Readmission to the ICU and Describing Patients-at-Risk

2019-05-21 · Sebastiano Barbieri, James Kemp, Oscar Perez-Concha, Sradha Kotwal 외

Objective: To compare different deep learning architectures for predicting the risk of readmission within 30 days of discharge from the intensive care unit (ICU). The interpretability of attention-based models is leverag…

Bayesian InferenceBenchmarking

Learning temporal embeddings from electronic health records of chronic kidney disease patients

2026-01-26 · Aditya Kumar, Mario A. Cypko, Oliver Amft arxiv

We investigate whether temporal embedding models trained on longitudinal electronic health records can learn clinically meaningful representations without compromising predictive performance, and how architectural choice…

Representation LearningICU Mortality

Recurrent autoencoder with sequence-aware encoding

2020-09-15 · Robert Susik

Recurrent Neural Networks (RNN) received a vast amount of attention last decade. Recently, the architectures of Recurrent AutoEncoders (RAE) found many applications in practice. RAE can extract the semantically valuable …

Prediction of the onset of cardiovascular diseases from electronic health records using multi-task gated recurrent units

2020-07-16 · Fernando Andreotti, Frank S. Heldt, Basel Abu-Jamous, Ming Li 외

In this work, we propose a multi-task recurrent neural network with attention mechanism for predicting cardiovascular events from electronic health records (EHRs) at different time horizons. The proposed approach is comp…

BIG-bench Machine Learning

MUSE-Net: Missingness-aware mUlti-branching Self-attention Encoder for Irregular Longitudinal Electronic Health Records

2024-06-30 · Zekai Wang, Tieming Liu, Bing Yao

The era of big data has made vast amounts of clinical data readily available, particularly in the form of electronic health records (EHRs), which provides unprecedented opportunities for developing data-driven diagnostic…

Decision MakingDiagnosticDisease PredictionImputation