paper-with-me

Papers

Deep Proxy Causal Learning and its Application to Confounded Bandit Policy Evaluation

2021-06-07 · NeurIPS 2021 12 · Liyuan Xu, Heishiro Kanagawa, Arthur Gretton

Proxy causal learning (PCL) is a method for estimating the causal effect of treatments on outcomes in the presence of unobserved confounding, using proxies (structured side information) for the confounder. This is achieved via two-stage regression: in the first stage, we model relations among the treatment and proxies; in the second stage, we use this model to learn the effect of treatment on the outcome, given the context provided by the proxies. PCL guarantees recovery of the true causal effect, subject to identifiability conditions. We propose a novel method for PCL, the deep feature proxy variable method (DFPV), to address the case where the proxies, treatments, and outcomes are high-dimensional and have nonlinear complex relationships, as represented by deep neural network features. We show that DFPV outperforms recent state-of-the-art PCL methods on challenging synthetic benchmarks, including settings involving high dimensional image data. Furthermore, we show that PCL can be applied to off-policy evaluation for the confounded bandit problem, in which DFPV also exhibits competitive performance.

📄 PDF Abstract BibTeX arXiv:2106.03907

Code (1)

liyuan9988/deepfeatureproxyvariable jax

Tasks

Off-policy evaluation

Similar Papers 제목 키워드 기반

Robustly Improving Bandit Algorithms with Confounded and Selection Biased Offline Data: A Causal Approach

2023-12-20 · Wen Huang, Xintao Wu

This paper studies bandit problems where an agent has access to offline data that might be utilized to potentially improve the estimation of each arm's reward distribution. A major obstacle in this setting is the existen…

Selection bias

Model-Based Reinforcement Learning Under Confounding

2025-12-08 · Nishanth Venkatesh, Andreas A. Malikopoulos arxiv

We investigate model-based reinforcement learning in contextual Markov decision processes (C-MDPs) in which the context is unobserved and induces confounding in the offline dataset. In such settings, conventional model-l…

Reinforcement Learning

Bandits with Partially Observable Confounded Data

2020-06-11 · Guy Tennenholtz, Uri Shalit, Shie Mannor, Yonathan Efroni

We study linear contextual bandits with access to a large, confounded, offline dataset that was sampled from some fixed policy. We show that this problem is closely related to a variant of the bandit problem with side in…

Multi-Armed Bandits

Optimal Treatment Regimes for Proximal Causal Learning

2023-09-21 · NeurIPS 2023 11

A common concern when a policymaker draws causal inferences from and makes decisions based on observational data is that the measured covariates are insufficiently rich to account for all sources of confounding, i.e., th…

On the Non-Monotonicity of a Non-Differentially Mismeasured Binary Confounder

2021-01-20 · Jose M. Peña

Suppose that we are interested in the average causal effect of a binary treatment on an outcome when this relationship is confounded by a binary confounder. Suppose that the confounder is unobserved but a non-differentia…