paper-with-me

홈 › Papers

An optimal learning method for developing personalized treatment regimes

2016-07-06 · Yingfei Wang, Warren Powell

A treatment regime is a function that maps individual patient information to a recommended treatment, hence explicitly incorporating the heterogeneity in need for treatment across individuals. Patient responses are dichotomous and can be predicted through an unknown relationship that depends on the patient information and the selected treatment. The goal is to find the treatments that lead to the best patient responses on average. Each experiment is expensive, forcing us to learn the most from each experiment. We adopt a Bayesian approach both to incorporate possible prior information and to update our treatment regime continuously as information accrues, with the potential to allow smaller yet more informative trials and for patients to receive better treatment. By formulating the problem as contextual bandits, we introduce a knowledge gradient policy to guide the treatment assignment by maximizing the expected value of information, for which an approximation method is used to overcome computational challenges. We provide a detailed study on how to make sequential medical decisions under uncertainty to reduce health care costs on a real world knee replacement dataset. We use clustering and LASSO to deal with the intrinsic sparsity in health datasets. We show experimentally that even though the problem is sparse, through careful selection of physicians (versus picking them at random), we can significantly improve the success rates.

📄 PDF Abstract BibTeX arXiv:1607.01462

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringMulti-Armed Bandits

Similar Papers 제목 키워드 기반

Median Optimal Treatment Regimes

2021-03-02 · Liu Leqi, Edward H. Kennedy

Optimal treatment regimes are personalized policies for making a treatment decision based on subject characteristics, with the policy chosen to maximize some value. It is common to aim to maximize the mean outcome in the…

DTR Bandit: Learning to Make Response-Adaptive Decisions With Low Regret

2020-05-06 · Yichun Hu, Nathan Kallus

Dynamic treatment regimes (DTRs) are personalized, adaptive, multi-stage treatment plans that adapt treatment decisions both to an individual's initial features and to intermediate outcomes and features at each subsequen…

On Multiple Robustness of Proximal Dynamic Treatment Regimes

2025-10-23 · Yuanshan Gao, Yang Bai, Yifan Cui arxiv

Dynamic treatment regimes are sequential decision rules that adapt treatment according to individual time-varying characteristics and outcomes to achieve optimal effects, with applications in precision medicine, personal…

Causal Inference

Near-Optimal Reinforcement Learning in Dynamic Treatment Regimes

2019-12-01 · NeurIPS 2019 12 · Junzhe Zhang, Elias Bareinboim

A dynamic treatment regime (DTR) consists of a sequence of decision rules, one per stage of intervention, that dictates how to determine the treatment assignment to patients based on evolving treatments and covariates' h…

Decision Makingreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Safe and Interpretable Estimation of Optimal Treatment Regimes

2023-10-23 · Harsh Parikh, Quinn Lanners, Zade Akras, Sahar F. Zafar 외

Recent statistical and reinforcement learning methods have significantly advanced patient care strategies. However, these approaches face substantial challenges in high-stakes contexts, including missing data, inherent s…