paper-with-me

Papers

Kernel Debiased Plug-in Estimation: Simultaneous, Automated Debiasing without Influence Functions for Many Target Parameters

2023-06-14 · Brian Cho, Yaroslav Mukhin, Kyra Gan, Ivana Malenica

When estimating target parameters in nonparametric models with nuisance parameters, substituting the unknown nuisances with nonparametric estimators can introduce ``plug-in bias.'' Traditional methods addressing this suboptimal bias-variance trade-off rely on the \emph{influence function} (IF) of the target parameter. When estimating multiple target parameters, these methods require debiasing the nuisance parameter multiple times using the corresponding IFs, which poses analytical and computational challenges. In this work, we leverage the \emph{targeted maximum likelihood estimation} (TMLE) framework to propose a novel method named \emph{kernel debiased plug-in estimation} (KDPE). KDPE refines an initial estimate through regularized likelihood maximization steps, employing a nonparametric model based on \emph{reproducing kernel Hilbert spaces}. We show that KDPE: (i) simultaneously debiases \emph{all} pathwise differentiable target parameters that satisfy our regularity conditions, (ii) does not require the IF for implementation, and (iii) remains computationally tractable. We numerically illustrate the use of KDPE and validate our theoretical results.

📄 PDF Abstract BibTeX arXiv:2306.08598

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Kernel Debiased Plug-in Estimation based on the Universal Least Favorable Submodel

2026-03-09 · Haiyi Chen, Yang Liu, Ivana Malenica arxiv

We propose ULFS-KDPE, a kernel debiased plug-in estimator based on the universal least favorable submodel, for estimating pathwise differentiable parameters in nonparametric models. The method constructs a data-adaptive …

DiScoFormer: Plug-In Density and Score Estimation with Transformers

2025-11-08 · Vasily Ilin, Peter Sushko, Ranjay Krishna arxiv

Estimating probability density and its score from samples remains a core problem in generative modeling, Bayesian inference, and kinetic theory. Existing methods are bifurcated: classical kernel density estimators (KDE) …

Density EstimationBayesian Inference

C-Learner: Constrained Learning for Causal Inference and Semiparametric Statistics

2024-05-15 · Tiffany Tianhui Cai, Yuri Fonseca, Kaiwen Hou, Hongseok Namkoong

Popular debiased causal estimation methods, e.g. for the average treatment effect -- such as one-step estimation (e.g., augmented inverse propensity weighting) and targeted maximum likelihood estimation -- enjoy desirabl…

Causal Inference

Direct Debiased Machine Learning via Bregman Divergence Minimization

2025-10-27 · Masahiro Kato arxiv

We develop a direct debiased machine learning framework comprising Neyman targeted estimation and generalized Riesz regression. Our framework unifies Riesz regression for automatic debiased machine learning, covariate ba…

Debiased neural operators for estimating functionals

2026-04-21 · Konstantin Hess, Dennis Frauen, Niki Kilbertus, Stefan Feuerriegel arxiv

Neural operators are widely used to approximate solution maps of complex physical systems. In many applications, however, the goal is not to recover the full solution trajectory, but to summarize the solution trajectory …