paper-with-me

홈 › Papers

Double Machine Learning for Conditional Moment Restrictions: IV Regression, Proximal Causal Learning and Beyond

2025-06-17 · Daqian Shao, Ashkan Soleymani, Francesco Quinzan, Marta Kwiatkowska

Solving conditional moment restrictions (CMRs) is a key problem considered in statistics, causal inference, and econometrics, where the aim is to solve for a function of interest that satisfies some conditional moment equalities. Specifically, many techniques for causal inference, such as instrumental variable (IV) regression and proximal causal learning (PCL), are CMR problems. Most CMR estimators use a two-stage approach, where the first-stage estimation is directly plugged into the second stage to estimate the function of interest. However, naively plugging in the first-stage estimator can cause heavy bias in the second stage. This is particularly the case for recently proposed CMR estimators that use deep neural network (DNN) estimators for both stages, where regularisation and overfitting bias is present. We propose DML-CMR, a two-stage CMR estimator that provides an unbiased estimate with fast convergence rate guarantees. We derive a novel learning objective to reduce bias and develop the DML-CMR algorithm following the double/debiased machine learning (DML) framework. We show that our DML-CMR estimator can achieve the minimax optimal convergence rate of $O(N^{-1/2})$ under parameterisation and mild regularity conditions, where $N$ is the sample size. We apply DML-CMR to a range of problems using DNN estimators, including IV regression and proximal causal learning on real-world datasets, demonstrating state-of-the-art performance against existing CMR estimators and algorithms tailored to those problems.

📄 PDF Abstract BibTeX arXiv:2506.14950

Code (0)

등록된 구현이 없습니다.

Tasks

Causal InferenceEconometrics

Similar Papers 제목 키워드 기반

Functional Generalized Empirical Likelihood Estimation for Conditional Moment Restrictions

2022-07-11 · Heiner Kremer, Jia-Jie Zhu, Krikamol Muandet, Bernhard Schölkopf

Important problems in causal inference, economics, and, more generally, robust machine learning can be expressed as conditional moment restrictions, but estimation becomes challenging as it requires solving a continuum o…

BIG-bench Machine LearningCausal Inference

Learning Causal Relationships from Conditional Moment Restrictions by Importance Weighting

2021-09-29 · ICLR 2022 4 · Masahiro Kato, Masaaki Imaizumi, Kenichiro McAlinn, Shota Yasui 외

We consider learning causal relationships under conditional moment restrictions. Unlike causal inference under unconditional moment restrictions, conditional moment restrictions pose serious challenges for causal inferen…

Causal Inference

Learning Causal Models from Conditional Moment Restrictions by Importance Weighting

2021-08-03 · Masahiro Kato, Masaaki Imaizumi, Kenichiro McAlinn, Haruo Kakehi 외

We consider learning causal relationships under conditional moment restrictions. Unlike causal inference under unconditional moment restrictions, conditional moment restrictions pose serious challenges for causal inferen…

Causal Inference

Game-Theoretic Algorithms for Conditional Moment Matching

2022-08-19 · Gokul Swamy, Sanjiban Choudhury, J. Andrew Bagnell, Zhiwei Steven Wu

A variety of problems in econometrics and machine learning, including instrumental variable regression and Bellman residual minimization, can be formulated as satisfying a set of conditional moment restrictions (CMR). We…

Econometricsregression

Adversarial Generalized Method of Moments

2018-03-19 · Greg Lewis, Vasilis Syrgkanis

We provide an approach for learning deep neural net representations of models described via conditional moment restrictions. Conditional moment restrictions are widely used, as they are the language by which social scien…

Causal InferenceClustering