Policy Learning for Optimal Dynamic Treatment Regimes with Observational Data
Public policies and medical interventions often involve dynamic treatment assignments, in which individuals receive a sequence of interventions over multiple stages. We study the statistical learning of optimal dynamic treatment regimes (DTRs) that determine the optimal treatment assignment for each individual at each stage based on their evolving history. We propose a novel, doubly robust, classification-based method for learning the optimal DTR from observational data under the sequential ignorability assumption. The method proceeds via backward induction: at each stage, it constructs and maximizes an augmented inverse probability weighting (AIPW) estimator of the policy value function to learn the optimal stage-specific policy. We show that the resulting DTR achieves an optimal convergence rate of $n^{-1/2}$ for welfare regret under mild convergence conditions on estimators of the nuisance components.
Code (0)
등록된 구현이 없습니다.
Tasks
Robust classificationSimilar Papers 제목 키워드 기반
Optimal Dynamic Treatment Regimes and Partial Welfare Ordering
Dynamic treatment regimes are treatment allocations tailored to heterogeneous individuals. The optimal dynamic treatment regime is a regime that maximizes counterfactual welfare. We introduce a framework in which we can …
counterfactualOn Multiple Robustness of Proximal Dynamic Treatment Regimes
Dynamic treatment regimes are sequential decision rules that adapt treatment according to individual time-varying characteristics and outcomes to achieve optimal effects, with applications in precision medicine, personal…
Causal InferenceNear-Optimal Reinforcement Learning in Dynamic Treatment Regimes
A dynamic treatment regime (DTR) consists of a sequence of decision rules, one per stage of intervention, that dictates how to determine the treatment assignment to patients based on evolving treatments and covariates' h…
Decision Makingreinforcement-learningReinforcement LearningReinforcement Learning (RL)Estimating and Improving Dynamic Treatment Regimes With a Time-Varying Instrumental Variable
Estimating dynamic treatment regimes (DTRs) from retrospective observational data is challenging as some degree of unmeasured confounding is often expected. In this work, we develop a framework of estimating properly def…
Ambiguous Dynamic Treatment Regimes: A Reinforcement Learning Approach
A main research goal in various studies is to use an observational data set and provide a new set of counterfactual guidelines that can yield causal improvements. Dynamic Treatment Regimes (DTRs) are widely studied to fo…
counterfactualDecision Makingreinforcement-learningReinforcement Learning+1