Learning Cost-Effective Treatment Regimes using Markov Decision Processes

2016-10-21 · Himabindu Lakkaraju, Cynthia Rudin

Decision makers, such as doctors and judges, make crucial decisions such as recommending treatments to patients, and granting bails to defendants on a daily basis. Such decisions typically involve weighting the potential benefits of taking an action against the costs involved. In this work, we aim to automate this task of learning \emph{cost-effective, interpretable and actionable treatment regimes}. We formulate this as a problem of learning a decision list -- a sequence of if-then-else rules -- which maps characteristics of subjects (eg., diagnostic test results of patients) to treatments. We propose a novel objective to construct a decision list which maximizes outcomes for the population, and minimizes overall costs. We model the problem of learning such a list as a Markov Decision Process (MDP) and employ a variant of the Upper Confidence Bound for Trees (UCT) strategy which leverages customized checks for pruning the search space effectively. Experimental results on real world observational data capturing judicial bail decisions and treatment recommendations for asthma patients demonstrate the effectiveness of our approach.

📄 PDF Abstract BibTeX arXiv:1610.06972

Code (0)

등록된 구현이 없습니다.

Tasks

Diagnostic

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Learning Cost-Effective and Interpretable Regimes for Treatment Recommendation

2016-11-23 · Himabindu Lakkaraju, Cynthia Rudin

Diagnostic

On Multiple Robustness of Proximal Dynamic Treatment Regimes

2025-10-23 · Yuanshan Gao, Yang Bai, Yifan Cui arxiv

Dynamic treatment regimes are sequential decision rules that adapt treatment according to individual time-varying characteristics and outcomes to achieve optimal effects, with applications in precision medicine, personal…

Causal Inference

Medical Knowledge Integration into Reinforcement Learning Algorithms for Dynamic Treatment Regimes

2024-06-29 · Sophia Yazzourh, Nicolas Savy, Philippe Saint-Pierre, Michael R. Kosorok

The goal of precision medicine is to provide individualized treatment at each stage of chronic diseases, a concept formalized by Dynamic Treatment Regimes (DTR). These regimes adapt treatment strategies based on decision…

reinforcement-learning Reinforcement Learning (RL)

Reinforcement Learning in Dynamic Treatment Regimes Needs Critical Reexamination

2024-05-28 · Zhiyao Luo, Yangchen Pan, Peter Watkinson, Tingting Zhu

In the rapidly changing healthcare landscape, the implementation of offline reinforcement learning (RL) in dynamic treatment regimes (DTRs) presents a mix of unprecedented opportunities and challenges. This position pape…

Offline RL reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Statistical Inference in Dynamic Treatment Regimes

2010-06-30 · Eric B. Laber, Min Qian, Dan J. Lizotte, William E. Pelham 외

Dynamic treatment regimes are of growing interest across the clinical sciences as these regimes provide one way to operationalize and thus inform sequential personalized clinical decision making. A dynamic treatment regi…

Decision Making