paper-with-me

홈 › Papers

Policy Learning for Optimal Dynamic Treatment Regimes with Observational Data

2024-03-30 · Shosei Sakaguchi

Public policies and medical interventions often involve dynamic treatment assignments, in which individuals receive a sequence of interventions over multiple stages. We study the statistical learning of optimal dynamic treatment regimes (DTRs) that determine the optimal treatment assignment for each individual at each stage based on their evolving history. We propose a novel, doubly robust, classification-based method for learning the optimal DTR from observational data under the sequential ignorability assumption. The method proceeds via backward induction: at each stage, it constructs and maximizes an augmented inverse probability weighting (AIPW) estimator of the policy value function to learn the optimal stage-specific policy. We show that the resulting DTR achieves an optimal convergence rate of $n^{-1/2}$ for welfare regret under mild convergence conditions on estimators of the nuisance components.

📄 PDF Abstract BibTeX arXiv:2404.00221

Code (0)

등록된 구현이 없습니다.

Tasks

Robust classification

Similar Papers 제목 키워드 기반

Optimal Dynamic Treatment Regimes and Partial Welfare Ordering

2019-12-20 · Sukjin Han

Dynamic treatment regimes are treatment allocations tailored to heterogeneous individuals. The optimal dynamic treatment regime is a regime that maximizes counterfactual welfare. We introduce a framework in which we can …

counterfactual

On Multiple Robustness of Proximal Dynamic Treatment Regimes

2025-10-23 · Yuanshan Gao, Yang Bai, Yifan Cui arxiv

Dynamic treatment regimes are sequential decision rules that adapt treatment according to individual time-varying characteristics and outcomes to achieve optimal effects, with applications in precision medicine, personal…

Causal Inference

Near-Optimal Reinforcement Learning in Dynamic Treatment Regimes

2019-12-01 · NeurIPS 2019 12 · Junzhe Zhang, Elias Bareinboim

A dynamic treatment regime (DTR) consists of a sequence of decision rules, one per stage of intervention, that dictates how to determine the treatment assignment to patients based on evolving treatments and covariates' h…

Decision Makingreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Estimating and Improving Dynamic Treatment Regimes With a Time-Varying Instrumental Variable

2021-04-15 · Shuxiao Chen, Bo Zhang

Estimating dynamic treatment regimes (DTRs) from retrospective observational data is challenging as some degree of unmeasured confounding is often expected. In this work, we develop a framework of estimating properly def…

Ambiguous Dynamic Treatment Regimes: A Reinforcement Learning Approach

2021-12-08 · Soroush Saghafian

A main research goal in various studies is to use an observational data set and provide a new set of counterfactual guidelines that can yield causal improvements. Dynamic Treatment Regimes (DTRs) are widely studied to fo…

counterfactualDecision Makingreinforcement-learningReinforcement Learning+1