Continuous State-Space Models for Optimal Sepsis Treatment - a Deep Reinforcement Learning Approach

2017-05-23 · Aniruddh Raghu, Matthieu Komorowski, Leo Anthony Celi, Peter Szolovits, Marzyeh Ghassemi

Sepsis is a leading cause of mortality in intensive care units (ICUs) and costs hospitals billions annually. Treating a septic patient is highly challenging, because individual patients respond very differently to medical interventions and there is no universally agreed-upon treatment for sepsis. Understanding more about a patient's physiological state at a given time could hold the key to effective treatment policies. In this work, we propose a new approach to deduce optimal treatment policies for septic patients by using continuous state-space models and deep reinforcement learning. Learning treatment policies over continuous spaces is important, because we retain more of the patient's physiological information. Our model is able to learn clinically interpretable treatment policies, similar in important aspects to the treatment policies of physicians. Evaluating our algorithm on past ICU patient data, we find that our model could reduce patient mortality in the hospital by up to 3.6% over observed clinical policies, from a baseline mortality of 13.7%. The learned treatment policies could be used to aid intensive care clinicians in medical decision making and improve the likelihood of patient survival.

📄 PDF Abstract BibTeX arXiv:1705.08422

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDeep Reinforcement LearningReinforcement Learning Reinforcement Learning (RL)State Space Models

Learning Optimal Treatment Strategies for Sepsis Using Offline Reinforcement Learning in Continuous Space

2022-06-22 · Zeyu Wang, Huiying Zhao, Peng Ren, Yuxi Zhou 외

Sepsis is a leading cause of death in the ICU. It is a disease requiring complex interventions in a short period of time, but its optimal treatment strategy remains uncertain. Evidence suggests that the practices of curr…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Model-Based Reinforcement Learning for Sepsis Treatment

2018-11-23 · Aniruddh Raghu, Matthieu Komorowski, Sumeetpal Singh

Sepsis is a dangerous condition that is a leading cause of patient mortality. Treating sepsis is highly challenging, because individual patients respond very differently to medical interventions and there is no universal…

model Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Deep Reinforcement Learning for Sepsis Treatment

2017-11-27 · Aniruddh Raghu, Matthieu Komorowski, Imran Ahmed, Leo Celi 외

Sepsis is a leading cause of mortality in intensive care units and costs hospitals billions annually. Treating a septic patient is highly challenging, because individual patients respond very differently to medical inter…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Formally Verifying and Explaining Sepsis Treatment Policies with COOL-MC

2026-02-16 · Dennis Gross arxiv

Safe and interpretable sequential decision-making is critical in healthcare, yet reinforcement learning (RL) policies for sepsis treatment optimization remain opaque and difficult to verify. Standard probabilistic model …

Reinforcement Learning

Offline reinforcement learning with uncertainty for treatment strategies in sepsis

2021-07-09 · Ran Liu, Joseph L. Greenstein, James C. Fackler, Jules Bergmann 외

Guideline-based treatment for sepsis and septic shock is difficult because sepsis is a disparate range of life-threatening organ dysfunctions whose pathophysiology is not fully understood. Early intervention in sepsis is…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)