paper-with-me

홈 › Papers

Kernel Debiased Plug-in Estimation based on the Universal Least Favorable Submodel

2026-03-09 · Haiyi Chen, Yang Liu, Ivana Malenica arxiv

We propose ULFS-KDPE, a kernel debiased plug-in estimator based on the universal least favorable submodel, for estimating pathwise differentiable parameters in nonparametric models. The method constructs a data-adaptive debiasing flow in a reproducing kernel Hilbert space (RKHS), producing a plug-in estimator that achieves semiparametric efficiency without requiring explicit derivation or evaluation of efficient influence functions. We place ULFS-KDPE on a rigorous functional-analytic foundation by formulating the universal least favorable update as a nonlinear ordinary differential equation on probability densities. We establish existence, uniqueness, stability, and finite-time convergence of the empirical score along the induced flow. Under standard regularity conditions, the resulting estimator is regular, asymptotically linear, and attains the semiparametric efficiency bound simultaneously for a broad class of pathwise differentiable parameters. The method admits a computationally tractable implementation based on finite-dimensional kernel representations and principled stopping criteria. In finite samples, the combination of solving a rich collection of score equations with RKHS-based smoothing and avoidance of direct influence-function evaluation leads to improved numerical stability. Simulation studies illustrate the method and support the theoretical results.

📄 PDF Abstract BibTeX arXiv:2603.08945

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Kernel Debiased Plug-in Estimation: Simultaneous, Automated Debiasing without Influence Functions for Many Target Parameters

2023-06-14 · Brian Cho, Yaroslav Mukhin, Kyra Gan, Ivana Malenica

When estimating target parameters in nonparametric models with nuisance parameters, substituting the unknown nuisances with nonparametric estimators can introduce ``plug-in bias.'' Traditional methods addressing this sub…

DiScoFormer: Plug-In Density and Score Estimation with Transformers

2025-11-08 · Vasily Ilin, Peter Sushko, Ranjay Krishna arxiv

Estimating probability density and its score from samples remains a core problem in generative modeling, Bayesian inference, and kinetic theory. Existing methods are bifurcated: classical kernel density estimators (KDE) …

Density EstimationBayesian Inference

C-Learner: Constrained Learning for Causal Inference and Semiparametric Statistics

2024-05-15 · Tiffany Tianhui Cai, Yuri Fonseca, Kaiwen Hou, Hongseok Namkoong

Popular debiased causal estimation methods, e.g. for the average treatment effect -- such as one-step estimation (e.g., augmented inverse propensity weighting) and targeted maximum likelihood estimation -- enjoy desirabl…

Causal Inference

Direct Debiased Machine Learning via Bregman Divergence Minimization

2025-10-27 · Masahiro Kato arxiv

We develop a direct debiased machine learning framework comprising Neyman targeted estimation and generalized Riesz regression. Our framework unifies Riesz regression for automatic debiased machine learning, covariate ba…

Nearest Neighbor Matching as Least Squares Density Ratio Estimation and Riesz Regression

2025-10-28 · Masahiro Kato arxiv

This study proves that Nearest Neighbor (NN) matching can be interpreted as an instance of Riesz regression for automatic debiased machine learning. Lin et al. (2023) shows that NN matching is an instance of density-rati…