Counterfactual inference for sequential experiments
We consider after-study statistical inference for sequentially designed experiments wherein multiple units are assigned treatments for multiple time points using treatment policies that adapt over time. Our goal is to provide inference guarantees for the counterfactual mean at the smallest possible scale -- mean outcome under different treatments for each unit and each time -- with minimal assumptions on the adaptive treatment policy. Without any structural assumptions on the counterfactual means, this challenging task is infeasible due to more unknowns than observed data points. To make progress, we introduce a latent factor model over the counterfactual means that serves as a non-parametric generalization of the non-linear mixed effects model and the bilinear latent factor model considered in prior works. For estimation, we use a non-parametric method, namely a variant of nearest neighbors, and establish a non-asymptotic high probability error bound for the counterfactual mean for each unit and each time. Under regularity conditions, this bound leads to asymptotically valid confidence intervals for the counterfactual mean as the number of units and time points grows to $\infty$ together at suitable rates. We illustrate our theory via several simulations and a case study involving data from a mobile health clinical trial HeartSteps.
Code (1)
Tasks
counterfactualCounterfactual InferenceExperimental DesignMatrix CompletionvalidSimilar Papers 제목 키워드 기반
Sequential Counterfactual Inference for Temporal Clinical Data: Addressing the Time Traveler Dilemma
Counterfactual inference enables clinicians to ask "what if" questions about patient outcomes, but standard methods assume feature independence and simultaneous modifiability -- assumptions violated by longitudinal clini…
Sequential Conditional Transport on Probabilistic Graphs for Interpretable Counterfactual Fairness
In this paper, we link two existing approaches to derive counterfactuals: adaptations based on a causal graph, and optimal transport. We extend "Knothe's rearrangement" and "triangular transport" to probabilistic graphic…
counterfactualFairnessCounterfactual Inference under Thompson Sampling
Recommender systems exemplify sequential decision-making under uncertainty, strategically deciding what content to serve to users, to optimise a range of potential objectives. To balance the explore-exploit trade-off suc…
Causal InferencecounterfactualCounterfactual InferenceDecision Making+4Causal Diffusion Models for Counterfactual Outcome Distributions in Longitudinal Data
Predicting counterfactual outcomes in longitudinal data, where sequential treatment decisions heavily depend on evolving patient states, is critical yet notoriously challenging due to complex time-dependent confounding a…
Causal InferenceCounterfactual Evaluation of Slate Recommendations with Sequential Reward Interactions
Users of music streaming, video streaming, news recommendation, and e-commerce services often engage with content in a sequential manner. Providing and evaluating good sequences of recommendations is therefore a central …
counterfactualNews RecommendationOff-policy evaluationRecommendation Systems