paper-with-me

Papers

Improving the Finite Sample Estimation of Average Treatment Effects using Double/Debiased Machine Learning with Propensity Score Calibration

2024-09-07 · Daniele Ballinari, Nora Bearth

In the last decade, machine learning techniques have gained popularity for estimating causal effects. One machine learning approach that can be used for estimating an average treatment effect is Double/debiased machine learning (DML) (Chernozhukov et al., 2018). This approach uses a double-robust score function that relies on the prediction of nuisance functions, such as the propensity score, which is the probability of treatment assignment conditional on covariates. Estimators relying on double-robust score functions are highly sensitive to errors in propensity score predictions. Machine learners increase the severity of this problem as they tend to over- or underestimate these probabilities. Several calibration approaches have been proposed to improve probabilistic forecasts of machine learners. This paper investigates the use of probability calibration approaches within the DML framework. Simulation results demonstrate that calibrating propensity scores may significantly reduces the root mean squared error of DML estimates of the average treatment effect in finite samples. We showcase it in an empirical example and provide conditions under which calibration does not alter the asymptotic properties of the DML estimator.

📄 PDF Abstract BibTeX arXiv:2409.04874

Code (1)

dballinari/improving-the-finite-sample-performance-of-dml-with-propensity-score-calibration 공식 구현

Similar Papers 제목 키워드 기반

Estimation and Inference of Average Treatment Effect in Percentage Points under Heterogeneity

2024-08-13 · Ying Zeng

In semi-log regression models with heterogeneous treatment effects, the average treatment effect (ATE) in log points and its exponential transformation minus one underestimate the ATE in percentage points. I propose new …

Semiparametric Single-Index Estimation for Average Treatment Effects

2022-06-17 · Difang Huang, Jiti Gao, Tatsushi Oka

We propose a semiparametric method to estimate the average treatment effect under the assumption of unconfoundedness given observational data. Our estimation method alleviates misspecification issues of the propensity sc…

valid

Meta-Learners for Estimation of Causal Effects: Finite Sample Cross-Fit Performance

2022-01-30 · Gabriel Okasa

Estimation of causal effects using machine learning methods has become an active research field in econometrics. In this paper, we study the finite sample performance of meta-learners for estimation of heterogeneous trea…

Econometrics

Efficient Adaptive Experimental Design for Average Treatment Effect Estimation

2020-02-13 · Masahiro Kato, Takuya Ishihara, Junya Honda, Yusuke Narita

We study how to efficiently estimate average treatment effects (ATEs) using adaptive experiments. In adaptive experiments, experimenters sequentially assign treatments to experimental units while updating treatment assig…

Experimental Designvalid

Estimation and Validation of Ratio-based Conditional Average Treatment Effects Using Observational Data

2019-12-15 · Steve Yadlowsky, Fabio Pellegrini, Federica Lionetto, Stefan Braune 외

While sample sizes in randomized clinical trials are large enough to estimate the average treatment effect well, they are often insufficient for estimation of treatment-covariate interactions critical to studying data-dr…

regression