paper-with-me

홈 › Papers

Identification of Subgroups With Similar Benefits in Off-Policy Policy Evaluation

2021-11-28 · Ramtin Keramati, Omer Gottesman, Leo Anthony Celi, Finale Doshi-Velez, Emma Brunskill

Off-policy policy evaluation methods for sequential decision making can be used to help identify if a proposed decision policy is better than a current baseline policy. However, a new decision policy may be better than a baseline policy for some individuals but not others. This has motivated a push towards personalization and accurate per-state estimates of heterogeneous treatment effects (HTEs). Given the limited data present in many important applications, individual predictions can come at a cost to accuracy and confidence in such predictions. We develop a method to balance the need for personalization with confident predictions by identifying subgroups where it is possible to confidently estimate the expected difference in a new decision policy relative to a baseline. We propose a novel loss function that accounts for uncertainty during the subgroup partitioning phase. In experiments, we show that our method can be used to form accurate predictions of HTEs where other methods struggle.

📄 PDF Abstract BibTeX arXiv:2111.14272

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingSequential Decision Making

Similar Papers 제목 키워드 기반

Bayesian Supervised Causal Clustering

2026-03-05 · Luwei Wang, Nazir Lone, Sohan Seth arxiv

Finding patient subgroups with similar characteristics is crucial for personalized decision-making in various disciplines such as healthcare and policy evaluation. While most existing approaches rely on unsupervised clus…

Offline Policy Evaluation of Multi-Turn LLM Health Coaching with Real Users

2025-10-20 · Melik Ozolcer, Sang Won Bae arxiv

We study a web-deployed, tool-augmented LLM health coach with real users. In a pilot with seven users (280 rated turns), offline policy evaluation (OPE) over factorized decision heads (Tool/Style) shows that a uniform he…

How Should We Represent History in Interpretable Models of Clinical Policies?

2024-12-10 · Anton Matsson, Lena Stempfle, Yaochen Rao, Zachary R. Margolin 외

Modeling policies for sequential clinical decision-making based on observational data is useful for describing treatment practices, standardizing frequent patterns in treatment, and evaluating alternative policies. For e…

Decision MakingRepresentation LearningSequential Decision Making

From Unsupervised Subgroups to Hypothetical State-Intervention Policies: An Evaluation of Selected Subgrouping Methods in Observational Health Data

2026-07-29 · Vasundhara Acharya, Bulent Yener arxiv

Conventional subgroup analyses can yield unstable and difficult-to-interpret conclusions, especially in observational biomedical data where each individual is observed under only one exposure state, true individual treat…

Uncovering Latent Biases in Text: Method and Application to Peer Review

2020-10-29 · Emaad Manzoor, Nihar B. Shah

Quantifying systematic disparities in numerical quantities such as employment rates and wages between population subgroups provides compelling evidence for the existence of societal biases. However, biases in the text wr…