Double Machine Learning for Adaptive Causal Representation in High-Dimensional Data

2024-11-22 · Lynda Aouar, Han Yu

Adaptive causal representation learning from observational data is presented, integrated with an efficient sample splitting technique within the semiparametric estimating equation framework. The support points sample splitting (SPSS), a subsampling method based on energy distance, is employed for efficient double machine learning (DML) in causal inference. The support points are selected and split as optimal representative points of the full raw data in a random sample, in contrast to the traditional random splitting, and providing an optimal sub-representation of the underlying data generating distribution. They offer the best representation of a full big dataset, whereas the unit structural information of the underlying distribution via the traditional random data splitting is most likely not preserved. Three machine learning estimators were adopted for causal inference, support vector machine (SVM), deep learning (DL), and a hybrid super learner (SL) with deep learning (SDL), using SPSS. A comparative study is conducted between the proposed SVM, DL, and SDL representations using SPSS, and the benchmark results from Chernozhukov et al. (2018), which employed random forest, neural network, and regression trees with a random k-fold cross-fitting technique on the 401(k)-pension plan real data. The simulations show that DL with SPSS and the hybrid methods of DL and SL with SPSS outperform SVM with SPSS in terms of computational efficiency and the estimation quality, respectively.

📄 PDF Abstract BibTeX arXiv:2411.14665

Code (0)

등록된 구현이 없습니다.

Tasks

Causal Inference Computational Efficiency Representation Learning

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

DoubleML -- An Object-Oriented Implementation of Double Machine Learning in R

2021-03-17 · Philipp Bach, Victor Chernozhukov, Malte S. Kurz, Martin Spindler 외

The R package DoubleML implements the double/debiased machine learning framework of Chernozhukov et al. (2018). It provides functionalities to estimate parameters in causal models based on machine learning methods. The d…

BIG-bench Machine Learning valid

DoubleML -- An Object-Oriented Implementation of Double Machine Learning in Python

2021-04-07 · Philipp Bach, Victor Chernozhukov, Malte S. Kurz, Martin Spindler

DoubleML is an open-source Python library implementing the double machine learning framework of Chernozhukov et al. (2018) for a variety of causal models. It contains functionalities for valid statistical inference on ca…

BIG-bench Machine Learning valid

Double Robust Representation Learning for Counterfactual Prediction

2020-10-15 · Shuxi Zeng, Serge Assaad, Chenyang Tao, Shounak Datta 외

Causal inference, or counterfactual prediction, is central to decision making in healthcare, policy and social sciences. To de-bias causal estimators with high-dimensional data in observational studies, recent advances s…

Causal Inference counterfactual Decision Making Prediction+1

Hyperparameter Tuning for Causal Inference with Double Machine Learning: A Simulation Study

2024-02-07 · Philipp Bach, Oliver Schacht, Victor Chernozhukov, Sven Klaassen 외

Proper hyperparameter tuning is essential for achieving optimal performance of modern machine learning (ML) methods in predictive tasks. While there is an extensive literature on tuning ML learners for prediction, there …

AutoML Causal Inference

Disentangled Double Machine Learning for Accurate Causal Effect Estimation

2026-05-24 · Guodu Xiang, Kui Yu, Yujie Wang, Richang Hong 외 arxiv

Confounding bias is a key challenge in causal effect estimation from observational data. Double Machine Learning (DML) addresses this issue by estimating treatment and outcome nuisance functions, constructing treatment a…