paper-with-me

홈 › Papers

Optimal Adaptive Experimental Design for Estimating Treatment Effect

2024-10-07 · Jiachun Li, David Simchi-Levi, Yunxiao Zhao

Given n experiment subjects with potentially heterogeneous covariates and two possible treatments, namely active treatment and control, this paper addresses the fundamental question of determining the optimal accuracy in estimating the treatment effect. Furthermore, we propose an experimental design that approaches this optimal accuracy, giving a (non-asymptotic) answer to this fundamental yet still open question. The methodological contribution is listed as following. First, we establish an idealized optimal estimator with minimal variance as benchmark, and then demonstrate that adaptive experiment is necessary to achieve near-optimal estimation accuracy. Secondly, by incorporating the concept of doubly robust method into sequential experimental design, we frame the optimal estimation problem as an online bandit learning problem, bridging the two fields of statistical estimation and bandit learning. Using tools and ideas from both bandit algorithm design and adaptive statistical estimation, we propose a general low switching adaptive experiment framework, which could be a generic research paradigm for a wide range of adaptive experimental design. Through novel lower bound techniques for non-i.i.d. data, we demonstrate the optimality of our proposed experiment. Numerical result indicates that the estimation accuracy approaches optimal with as few as two or three policy updates.

📄 PDF Abstract BibTeX arXiv:2410.05552

Code (0)

등록된 구현이 없습니다.

Tasks

Experimental Design

Similar Papers 제목 키워드 기반

Optimal Experimental Design for Staggered Rollouts

2019-11-09 · Ruoxuan Xiong, Susan Athey, Mohsen Bayati, Guido Imbens

In this paper, we study the design and analysis of experiments conducted on a set of units over multiple time periods where the starting time of the treatment may vary by unit. The design problem involves selecting an in…

Decision MakingExperimental Designvalid

Non-stationary Experimental Design under Linear Trends

2023-09-21 · NeurIPS 2023 11

Experimentation has been critical and increasingly popular across various domains, such as clinical trials and online platforms, due to its widely recognized benefits. One of the primary objectives of classical experime…

Minimax and Bayes Optimal Adaptive Experimental Design for Treatment Choice

2025-12-09 · Masahiro Kato arxiv

We consider an adaptive experiment for treatment choice and design a minimax and Bayes optimal adaptive experiment with respect to regret. Given binary treatments, the experimenter's goal is to choose the treatment with …

Confidence Intervals for Policy Evaluation in Adaptive Experiments

2019-11-07 · Vitor Hadad, David A. Hirshberg, Ruohan Zhan, Stefan Wager 외

Adaptive experiment designs can dramatically improve statistical efficiency in randomized trials, but they also complicate statistical inference. For example, it is now well known that the sample mean is biased in adapti…

Experimental DesignMulti-Armed Bandits

Active Adaptive Experimental Design for Treatment Effect Estimation with Covariate Choices

2024-03-06 · Masahiro Kato, Akihiro Oga, Wataru Komatsubara, Ryo Inokuchi

This study designs an adaptive experiment for efficiently estimating average treatment effects (ATEs). In each round of our adaptive experiment, an experimenter sequentially samples an experimental unit, assigns a treatm…

Experimental Design