paper-with-me

홈 › Papers

A Knowledge Distillation Ensemble Framework for Predicting Short and Long-term Hospitalisation Outcomes from Electronic Health Records Data

2020-11-18 · Zina M Ibrahim, Daniel Bean, Thomas Searle, Honghan Wu, Anthony Shek, Zeljko Kraljevic, James Galloway, Sam Norton, James T Teo, Richard JB Dobson

The ability to perform accurate prognosis of patients is crucial for proactive clinical decision making, informed resource management and personalised care. Existing outcome prediction models suffer from a low recall of infrequent positive outcomes. We present a highly-scalable and robust machine learning framework to automatically predict adversity represented by mortality and ICU admission from time-series vital signs and laboratory results obtained within the first 24 hours of hospital admission. The stacked platform comprises two components: a) an unsupervised LSTM Autoencoder that learns an optimal representation of the time-series, using it to differentiate the less frequent patterns which conclude with an adverse event from the majority patterns that do not, and b) a gradient boosting model, which relies on the constructed representation to refine prediction, incorporating static features of demographics, admission details and clinical summaries. The model is used to assess a patient's risk of adversity over time and provides visual justifications of its prediction based on the patient's static features and dynamic signals. Results of three case studies for predicting mortality and ICU admission show that the model outperforms all existing outcome prediction models, achieving PR-AUC of 0.891 (95$%$ CI: 0.878 - 0.969) in predicting mortality in ICU and general ward settings and 0.908 (95$%$ CI: 0.870-0.935) in predicting ICU admission.

📄 PDF Abstract BibTeX arXiv:2011.09361

Code (1)

zibrahim/KD-OP 공식 구현

Tasks

Decision MakingICU AdmissionKnowledge DistillationManagementOutlier Detectionoutlier ensemblesPredictionPrognosisTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Solana Customer Service Number +1-833-534-1729 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Periodic Intra-Ensemble Knowledge Distillation for Reinforcement Learning

2020-02-01 · Zhang-Wei Hong, Prabhat Nagarajan, Guilherme Maeda

Off-policy ensemble reinforcement learning (RL) methods have demonstrated impressive results across a range of RL benchmark tasks. Recent works suggest that directly imitating experts' policies in a supervised manner bef…

Knowledge DistillationMuJoCoreinforcement-learningReinforcement Learning+1

Online Ensemble Model Compression using Knowledge Distillation

2020-11-15 · ECCV 2020 8 · Devesh Walawalkar, Zhiqiang Shen, Marios Savvides

This paper presents a novel knowledge distillation based model compression framework consisting of a student ensemble. It enables distillation of simultaneously learnt ensemble knowledge onto each of the compressed stude…

Knowledge DistillationmodelModel Compression

Neural Architecture Search via Ensemble-based Knowledge Distillation

2021-09-29 · Fanxin Li, Shixiong Zhao, Haowen Pi, Yuhao QING 외

Neural Architecture Search (NAS) automatically searches for well-performed network architectures from a given search space. The One-shot NAS method improves the training efficiency by sharing weights among the possible a…

DiversityKnowledge DistillationNeural Architecture Search

Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning

2020-12-17 · Zeyuan Allen-Zhu, Yuanzhi Li

We formally study how ensemble of deep learning models can improve test accuracy, and how the superior performance of ensemble can be distilled into a single model using knowledge distillation. We consider the challengin…

Deep LearningKnowledge DistillationLearning Theory

DGEKT: A Dual Graph Ensemble Learning Method for Knowledge Tracing

2022-11-23 · Chaoran Cui, Yumo Yao, Chunyun Zhang, Hebo Ma 외

Knowledge tracing aims to trace students' evolving knowledge states by predicting their future performance on concept-related exercises. Recently, some graph-based models have been developed to incorporate the relationsh…

Ensemble LearningKnowledge DistillationKnowledge Tracing