Deep Learning of Continuous and Structured Policies for Aggregated Heterogeneous Treatment Effects

2025-07-07 · Jennifer Y. Zhang, Shuyang Du, Will Y. Zou arxiv

As estimation of Heterogeneous Treatment Effect (HTE) is increasingly adopted across a wide range of scientific and industrial applications, the treatment action space can naturally expand, from a binary treatment variable to a structured treatment policy. This policy may include several policy factors such as a continuous treatment intensity variable, or discrete treatment assignments. From first principles, we derive the formulation for incorporating multiple treatment policy variables into the functional forms of individual and average treatment effects. Building on this, we develop a methodology to directly rank subjects using aggregated HTE functions. In particular, we construct a Neural-Augmented Naive Bayes layer within a deep learning framework to incorporate an arbitrary number of factors that satisfies the Naive Bayes assumption. The factored layer is then applied with continuous treatment variables, treatment assignment, and direct ranking of aggregated treatment effect functions. Together, these algorithms build towards a generic framework for deep learning of heterogeneous treatment policies, and we show their power to improve performance with public datasets.

📄 PDF Abstract BibTeX arXiv:2507.05511

Code (0)

등록된 구현이 없습니다.

Effect or Treatment Heterogeneity? Policy Evaluation with Aggregated and Disaggregated Treatments

2021-10-04 · Phillip Heiler, Michael C. Knaus

Binary treatments are often ex-post aggregates of multiple treatments or can be disaggregated into multiple treatment versions. Thus, effects can be heterogeneous due to either effect or treatment heterogeneity. We propo…

Continuous State-Space Models for Optimal Sepsis Treatment - a Deep Reinforcement Learning Approach

2017-05-23 · Aniruddh Raghu, Matthieu Komorowski, Leo Anthony Celi, Peter Szolovits 외

Sepsis is a leading cause of mortality in intensive care units (ICUs) and costs hospitals billions annually. Treating a septic patient is highly challenging, because individual patients respond very differently to medica…

Decision Making Deep Reinforcement Learning Reinforcement Learning Reinforcement Learning (RL)+1

Learning Continuous Treatment Policy and Bipartite Embeddings for Matching with Heterogeneous Causal Effects

2020-04-21 · Will Y. Zou, Smitha Shyam, Michael Mui, Mingshi Wang 외

Causal inference methods are widely applied in the fields of medicine, policy, and economics. Central to these applications is the estimation of treatment effects to make decisions. Current methods make binary yes-or-no …

Causal Inference counterfactual

Deep Reinforcement Learning for Sepsis Treatment

2017-11-27 · Aniruddh Raghu, Matthieu Komorowski, Imran Ahmed, Leo Celi 외

Sepsis is a leading cause of mortality in intensive care units and costs hospitals billions annually. Treating a septic patient is highly challenging, because individual patients respond very differently to medical inter…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Learning to Treat Sepsis with Multi-Output Gaussian Process Deep Recurrent Q-Networks

2018-01-01 · ICLR 2018 1 · Joseph Futoma, Anthony Lin, Mark Sendak, Armando Bedoya 외

Sepsis is a life-threatening complication from infection and a leading cause of mortality in hospitals. While early detection of sepsis improves patient outcomes, there is little consensus on exact treatment guidelines,…

Deep Reinforcement Learning Gaussian Processes Missing Values reinforcement-learning+4