paper-with-me

Papers

Multi-Task Prediction of Clinical Outcomes in the Intensive Care Unit using Flexible Multimodal Transformers

2021-11-09 · Benjamin Shickel, Patrick J. Tighe, Azra Bihorac, Parisa Rashidi

Recent deep learning research based on Transformer model architectures has demonstrated state-of-the-art performance across a variety of domains and tasks, mostly within the computer vision and natural language processing domains. While some recent studies have implemented Transformers for clinical tasks using electronic health records data, they are limited in scope, flexibility, and comprehensiveness. In this study, we propose a flexible Transformer-based EHR embedding pipeline and predictive model framework that introduces several novel modifications of existing workflows that capitalize on data attributes unique to the healthcare domain. We showcase the feasibility of our flexible design in a case study in the intensive care unit, where our models accurately predict seven clinical outcomes pertaining to readmission and patient mortality over multiple future time horizons.

📄 PDF Abstract BibTeX arXiv:2111.05431

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

BERTSurv: BERT-Based Survival Models for Predicting Outcomes of Trauma Patients

2021-03-19 · Yun Zhao, Qinghang Hong, Xinlu Zhang, Yu Deng 외

Survival analysis is a technique to predict the times of specific outcomes, and is widely used in predicting the outcomes for intensive care unit (ICU) trauma patients. Recently, deep learning models have drawn increasin…

Deep LearningMortality PredictionSurvival Analysis

XAI for In-hospital Mortality Prediction via Multimodal ICU Data

2023-12-29 · Xingqiao Li, Jindong Gu, Zhiyong Wang, Yancheng Yuan 외

Predicting in-hospital mortality for intensive care unit (ICU) patients is key to final clinical outcomes. AI has shown advantaged accuracy but suffers from the lack of explainability. To address this issue, this paper p…

Decision MakingMortality Prediction

Precision ICU Resource Planning: A Multimodal Model for Brain Surgery Outcomes

2024-12-20 · Maximilian Fischer, Florian M. Hauptmann, Robin Peretzke, Paul Naser 외

Although advances in brain surgery techniques have led to fewer postoperative complications requiring Intensive Care Unit (ICU) monitoring, the routine transfer of patients to the ICU remains the clinical standard, despi…

ICU Admission

Predicting Clinical Outcomes with Waveform LSTMs

2025-03-13 · Michael Albada

Data mining and machine learning hold great potential to enable health systems to systematically use data and analytics to identify inefficiencies and best practices that improve care and reduce costs. Waveform data offe…

Unmasking Societal Biases in Respiratory Support for ICU Patients through Social Determinants of Health

2025-02-23 · Mira Moukheiber, Lama Moukheiber, Dana Moukheiber, Hyung-Chul Lee

In critical care settings, where precise and timely interventions are crucial for health outcomes, evaluating disparities in patient outcomes is essential. Current approaches often fail to fully capture the impact of res…

BenchmarkingFairness