Personalized Medical Treatments Using Novel Reinforcement Learning Algorithms

2014-06-16 · Yousuf M. Soliman

In both the fields of computer science and medicine there is very strong interest in developing personalized treatment policies for patients who have variable responses to treatments. In particular, I aim to find an optimal personalized treatment policy which is a non-deterministic function of the patient specific covariate data that maximizes the expected survival time or clinical outcome. I developed an algorithmic framework to solve multistage decision problem with a varying number of stages that are subject to censoring in which the "rewards" are expected survival times. In specific, I developed a novel Q-learning algorithm that dynamically adjusts for these parameters. Furthermore, I found finite upper bounds on the generalized error of the treatment paths constructed by this algorithm. I have also shown that when the optimal Q-function is an element of the approximation space, the anticipated survival times for the treatment regime constructed by the algorithm will converge to the optimal treatment path. I demonstrated the performance of the proposed algorithmic framework via simulation studies and through the analysis of chronic depression data and a hypothetical clinical trial. The censored Q-learning algorithm I developed is more effective than the state of the art clinical decision support systems and is able to operate in environments when many covariate parameters may be unobtainable or censored.

📄 PDF Abstract BibTeX arXiv:1406.3922

Code (0)

등록된 구현이 없습니다.

Tasks

Q-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Personalized Cancer Chemotherapy Schedule: a numerical comparison of performance and robustness in model-based and model-free scheduling methodologies

2019-04-02 · Jesus Tordesillas, Juncal Arbelaiz

Reinforcement learning algorithms are gaining popularity in fields in which optimal scheduling is important, and oncology is not an exception. The complex and uncertain dynamics of cancer limit the performance of traditi…

Deep Reinforcement Learning model Q-Learning reinforcement-learning+3

Knowledgeable Language Models as Black-Box Optimizers for Personalized Medicine

2025-09-25 · Michael S. Yao, Osbert Bastani, Alma Andersson, Tommaso Biancalani 외 arxiv

The goal of personalized medicine is to discover a treatment regimen that optimizes a patient's clinical outcome based on their personal genetic and environmental factors. However, candidate treatments cannot be arbitrar…

Knowledge Graphs

Reinforcement Learning for Personalized Drug Discovery and Design for Complex Diseases: A Systems Pharmacology Perspective

2022-01-21 · Ryan K. Tan, Yang Liu, Lei Xie

Many multi-genic systemic diseases such as neurological disorders, inflammatory diseases, and the majority of cancers do not have effective treatments yet. Reinforcement learning powered systems pharmacology is a potenti…

Drug Design Drug Discovery reinforcement-learning Reinforcement Learning+1

Learning Optimal Treatment Strategies for Sepsis Using Offline Reinforcement Learning in Continuous Space

2022-06-22 · Zeyu Wang, Huiying Zhao, Peng Ren, Yuxi Zhou 외

Sepsis is a leading cause of death in the ICU. It is a disease requiring complex interventions in a short period of time, but its optimal treatment strategy remains uncertain. Evidence suggests that the practices of curr…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Deep Reinforcement Learning for Dynamic Treatment Regimes on Medical Registry Data

2018-01-28 · Ning Liu, Ying Liu, Brent Logan, Zhiyuan Xu 외

This paper presents the first deep reinforcement learning (DRL) framework to estimate the optimal Dynamic Treatment Regimes from observational medical data. This framework is more flexible and adaptive for high dimension…