Method-of-Moments Inference for GLMs and Doubly Robust Functionals under Proportional Asymptotics
In this paper, we consider the estimation of regression coefficients and signal-to-noise (SNR) ratio in high-dimensional Generalized Linear Models (GLMs), and explore their implications in inferring popular estimands such as average treatment effects in high-dimensional observational studies. Under the ``proportional asymptotic'' regime and Gaussian covariates with known (population) covariance $\Sigma$, we derive Consistent and Asymptotically Normal (CAN) estimators of our targets of inference through a Method-of-Moments type of estimators that bypasses estimation of high dimensional nuisance functions and hyperparameter tuning altogether. Additionally, under non-Gaussian covariates, we demonstrate universality of our results under certain additional assumptions on the regression coefficients and $\Sigma$. We also demonstrate that knowing $\Sigma$ is not essential to our proposed methodology when the sample covariance matrix estimator is invertible. Finally, we complement our theoretical results with numerical experiments and comparisons with existing literature.
Code (1)
Tasks
regressionSimilar Papers 제목 키워드 기반
Automatic doubly robust inference for linear functionals via calibrated debiased machine learning
In causal inference, many estimands of interest can be expressed as a linear functional of the outcome regression function; this includes, for example, average causal effects of static, dynamic and stochastic interventio…
Causal InferenceregressionSimple Inference on Functionals of Set-Identified Parameters Defined by Linear Moments
This paper considers uniformly valid inference for linear functionals and scalar subvectors of partially identified parameters defined by linear moment inequalities. Our proposed procedure amounts to bootstrapping the va…
validSource Condition Double Robust Inference on Functionals of Inverse Problems
We consider estimation of parameters defined as linear functionals of solutions to linear inverse problems. Any such parameter admits a doubly robust representation that depends on the solution to a dual linear inverse p…
Minimax Kernel Machine Learning for a Class of Doubly Robust Functionals with Application to Proximal Causal Inference
Robins et al. (2008) introduced a class of influence functions (IFs) which could be used to obtain doubly robust moment functions for the corresponding parameters. However, that class does not include the IF of parameter…
BIG-bench Machine LearningCausal InferenceLearning TheoryNuisance Function Tuning and Sample Splitting for Optimal Doubly Robust Estimation
Estimators of doubly robust functionals typically rely on estimating two complex nuisance functions, such as the propensity score and conditional outcome mean for the average treatment effect functional. We consider the …
Causal Inference