paper-with-me

Papers

RieszBoost: Gradient Boosting for Riesz Regression

2025-01-08 · Kaitlyn J. Lee, Alejandro Schuler

Answering causal questions often involves estimating linear functionals of conditional expectations, such as the average treatment effect or the effect of a longitudinal modified treatment policy. By the Riesz representation theorem, these functionals can be expressed as the expected product of the conditional expectation of the outcome and the Riesz representer, a key component in doubly robust estimation methods. Traditionally, the Riesz representer is estimated indirectly by deriving its explicit analytical form, estimating its components, and substituting these estimates into the known form (e.g., the inverse propensity score). However, deriving or estimating the analytical form can be challenging, and substitution methods are often sensitive to practical positivity violations, leading to higher variance and wider confidence intervals. In this paper, we propose a novel gradient boosting algorithm to directly estimate the Riesz representer without requiring its explicit analytical form. This method is particularly suited for tabular data, offering a flexible, nonparametric, and computationally efficient alternative to existing methods for Riesz regression. Through simulation studies, we demonstrate that our algorithm performs on par with or better than indirect estimation techniques across a range of functionals, providing a user-friendly and robust solution for estimating causal quantities.

📄 PDF Abstract BibTeX arXiv:2501.04871

Code (0)

등록된 구현이 없습니다.

Tasks

Formregression

Similar Papers 제목 키워드 기반

Learning density ratios in causal inference using Bregman-Riesz regression

2025-10-17 · Oliver J. Hines, Caleb H. Miles arxiv

The ratio of two probability density functions is a fundamental quantity that appears in many areas of statistics and machine learning, including causal inference, reinforcement learning, covariate shift, outlier detecti…

Reinforcement LearningOutlier DetectionData AugmentationCausal Inference

A Unified Theory for Causal Inference: Direct Debiased Machine Learning via Bregman-Riesz Regression

2025-10-30 · Masahiro Kato arxiv

This note introduces a unified theory for causal inference that integrates Riesz regression, covariate balancing, density-ratio estimation (DRE), targeted maximum likelihood estimation (TMLE), and the matching estimator …

Causal Inference

Nearest Neighbor Matching as Least Squares Density Ratio Estimation and Riesz Regression

2025-10-28 · Masahiro Kato arxiv

This study proves that Nearest Neighbor (NN) matching can be interpreted as an instance of Riesz regression for automatic debiased machine learning. Lin et al. (2023) shows that NN matching is an instance of density-rati…

Direct Debiased Machine Learning via Bregman Divergence Minimization

2025-10-27 · Masahiro Kato arxiv

We develop a direct debiased machine learning framework comprising Neyman targeted estimation and generalized Riesz regression. Our framework unifies Riesz regression for automatic debiased machine learning, covariate ba…

Riesz Regression As Direct Density Ratio Estimation

2025-11-06 · Masahiro Kato arxiv

This study clarifies the relationship between Riesz regression [Chernozhukov et al., 2021] and density ratio estimation (DRE) in causal inference problems, such as average treatment effect estimation. We first show that …

Causal Inference