Offline reinforcement learning with uncertainty for treatment strategies in sepsis

2021-07-09 · Ran Liu, Joseph L. Greenstein, James C. Fackler, Jules Bergmann, Melania M. Bembea, Raimond L. Winslow

Guideline-based treatment for sepsis and septic shock is difficult because sepsis is a disparate range of life-threatening organ dysfunctions whose pathophysiology is not fully understood. Early intervention in sepsis is crucial for patient outcome, yet those interventions have adverse effects and are frequently overadministered. Greater personalization is necessary, as no single action is suitable for all patients. We present a novel application of reinforcement learning in which we identify optimal recommendations for sepsis treatment from data, estimate their confidence level, and identify treatment options infrequently observed in training data. Rather than a single recommendation, our method can present several treatment options. We examine learned policies and discover that reinforcement learning is biased against aggressive intervention due to the confounding relationship between mortality and level of treatment received. We mitigate this bias using subspace learning, and develop methodology that can yield more accurate learning policies across healthcare applications.

📄 PDF Abstract BibTeX arXiv:2107.04491

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning Optimal Treatment Strategies for Sepsis Using Offline Reinforcement Learning in Continuous Space

2022-06-22 · Zeyu Wang, Huiying Zhao, Peng Ren, Yuxi Zhou 외

Sepsis is a leading cause of death in the ICU. It is a disease requiring complex interventions in a short period of time, but its optimal treatment strategy remains uncertain. Evidence suggests that the practices of curr…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Conservative Q-Learning approach for handling distribution shift in sepsis treatment strategies

2022-03-25 · Pramod Kaushik, Sneha Kummetha, Perusha Moodley, Raju S. Bapi

Sepsis is a leading cause of mortality and its treatment is very expensive. Sepsis treatment is also very challenging because there is no consensus on what interventions work best and different patients respond very diff…

Deep Reinforcement Learning Offline RL Q-Learning

Unifying Cardiovascular Modelling with Deep Reinforcement Learning for Uncertainty Aware Control of Sepsis Treatment

2021-01-21 · Thesath Nanayakkara, Gilles Clermont, Christopher James Langmead, David Swigon

Sepsis is a potentially life threatening inflammatory response to infection or severe tissue damage. It has a highly variable clinical course, requiring constant monitoring of the patient's state to guide the management …

Clinical Knowledge Decision Making Under Uncertainty Deep Reinforcement Learning Distributional Reinforcement Learning+3

Improving Sepsis Treatment Strategies by Combining Deep and Kernel-Based Reinforcement Learning

2019-01-15 · Xuefeng Peng, Yi Ding, David Wihl, Omer Gottesman 외

Sepsis is the leading cause of mortality in the ICU. It is challenging to manage because individual patients respond differently to treatment. Thus, tailoring treatment to the individual patient is essential for the best…

Deep Reinforcement Learning Mixture-of-Experts reinforcement-learning Reinforcement Learning+1

Empowering Clinicians with Medical Decision Transformers: A Framework for Sepsis Treatment

2024-07-28 · Aamer Abdul Rahman, Pranav Agarwal, Rita Noumeir, Philippe Jouvet 외

Offline reinforcement learning has shown promise for solving tasks in safety-critical settings, such as clinical decision support. Its application, however, has been limited by the lack of interpretability and interactiv…

Off-policy evaluation reinforcement-learning Reinforcement Learning