paper-with-me

Papers

Confounding-Robust Policy Improvement

2018-05-22 · NeurIPS 2018 12 · Nathan Kallus, Angela Zhou

We study the problem of learning personalized decision policies from observational data while accounting for possible unobserved confounding. Previous approaches, which assume unconfoundedness, i.e., that no unobserved confounders affect both the treatment assignment as well as outcome, can lead to policies that introduce harm rather than benefit when some unobserved confounding is present, as is generally the case with observational data. Instead, since policy value and regret may not be point-identifiable, we study a method that minimizes the worst-case estimated regret of a candidate policy against a baseline policy over an uncertainty set for propensity weights that controls the extent of unobserved confounding. We prove generalization guarantees that ensure our policy will be safe when applied in practice and will in fact obtain the best-possible uniform control on the range of all possible population regrets that agree with the possible extent of confounding. We develop efficient algorithmic solutions to compute this confounding-robust policy. Finally, we assess and compare our methods on synthetic and semi-synthetic data. In particular, we consider a case study on personalizing hormone replacement therapy based on observational data, where we validate our results on a randomized experiment. We demonstrate that hidden confounding can hinder existing policy learning approaches and lead to unwarranted harm, while our robust approach guarantees safety and focuses on well-evidenced improvement, a necessity for making personalized treatment policies learned from observational data reliable in practice.

📄 PDF Abstract BibTeX arXiv:1805.08593

Code (0)

등록된 구현이 없습니다.

Tasks

Causal Inference

Similar Papers 제목 키워드 기반

Efficient and Sharp Off-Policy Learning under Unobserved Confounding

2025-02-18 · Konstantin Hess, Dennis Frauen, Valentyn Melnychuk, Stefan Feuerriegel

We develop a novel method for personalized off-policy learning in scenarios with unobserved confounding. Thereby, we address a key limitation of standard policy learning: standard policy learning assumes unconfoundedness…

Confounding-Robust Policy Improvement with Human-AI Teams

2023-10-13 · Ruijiang Gao, Mingzhang Yin

Human-AI collaboration has the potential to transform various domains by leveraging the complementary strengths of human experts and Artificial Intelligence (AI) systems. However, unobserved confounding can undermine the…

Causal InferenceSensitivity

Confounding Masquerading as Improvement: A Systematic Evaluation of Offline Reinforcement Learning for Stroke Antithrombotic Treatment in a 129,000-Patient Registry

2026-08-31 · Kihun Rhee arxiv

Recent offline reinforcement learning (RL) studies report policies that outperform physician decisions on clinical outcomes. We conduct a systematic, partially crossed evaluation of five offline RL algorithm families and…

Reinforcement LearningOffline RL

Offline Policy Evaluation and Optimization under Confounding

2022-11-29 · Chinmaya Kausik, Yangyi Lu, Kevin Tan, Maggie Makar 외

Evaluating and optimizing policies in the presence of unobserved confounders is a problem of growing interest in offline reinforcement learning. Using conventional methods for offline RL in the presence of confounding ca…

Offline RLOff-policy evaluationReinforcement Learning (RL)

Off-policy Policy Evaluation For Sequential Decisions Under Unobserved Confounding

2020-03-12 · NeurIPS 2020 12 · Hongseok Namkoong, Ramtin Keramati, Steve Yadlowsky, Emma Brunskill

When observed decisions depend only on observed features, off-policy policy evaluation (OPE) methods for sequential decision making problems can estimate the performance of evaluation policies before deploying them. This…

Decision MakingManagementSequential Decision Making