paper-with-me

Papers

What Estimators Are Unbiased For Linear Models?

2022-12-29 · Lihua Lei, Jeffrey Wooldridge

The recent thought-provoking paper by Hansen [2022, Econometrica] proved that the Gauss-Markov theorem continues to hold without the requirement that competing estimators are linear in the vector of outcomes. Despite the elegant proof, it was shown by the authors and other researchers that the main result in the earlier version of Hansen's paper does not extend the classic Gauss-Markov theorem because no nonlinear unbiased estimator exists under his conditions. To address the issue, Hansen [2022] added statements in the latest version with new conditions under which nonlinear unbiased estimators exist. Motivated by the lively discussion, we study a fundamental problem: what estimators are unbiased for a given class of linear models? We first review a line of highly relevant work dating back to the 1960s, which, unfortunately, have not drawn enough attention. Then, we introduce notation that allows us to restate and unify results from earlier work and Hansen [2022]. The new framework also allows us to highlight differences among previous conclusions. Lastly, we establish new representation theorems for unbiased estimators under different restrictions on the linear model, allowing the coefficients and covariance matrix to take only a finite number of values, the higher moments of the estimator and the dependent variable to exist, and the error distribution to be discrete, absolutely continuous, or dominated by another probability measure. Our results substantially generalize the claims of parallel commentaries on Hansen [2022] and a remarkable result by Koopmann [1982].

📄 PDF Abstract BibTeX arXiv:2212.14185

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Linear Response Estimators for Singular Statistical Models

2026-05-08 · Chris Elliott, Daniel Murfet arxiv

We define susceptibilities as a measure of the response of an observable quantity of a parameterized statistical model to a perturbation of the data for a general class of observables. We define estimators for these susc…

Barankin-Type Bound for Constrained Parameter Estimation

2023-04-17 · Eyal Nitzan, Tirza Routtenberg, Joseph Tabrikian

In constrained parameter estimation, the classical constrained Cramer-Rao bound (CCRB) and the recent Lehmann-unbiased CCRB (LU-CCRB) are lower bounds on the performance of mean-unbiased and Lehmann-unbiased estimators, …

Direction of Arrival Estimationparameter estimationVocal Bursts Type Prediction

Off-Policy Evaluation of Ranking Policies under Diverse User Behavior

2023-06-26 · Haruka Kiyohara, Masatoshi Uehara, Yusuke Narita, Nobuyuki Shimizu 외

Ranking interfaces are everywhere in online platforms. There is thus an ever growing interest in their Off-Policy Evaluation (OPE), aiming towards an accurate performance evaluation of ranking policies using logged data.…

Off-policy evaluation

Meta Off-Policy Estimation

2025-08-11 · Olivier Jeunen arxiv

Off-policy estimation (OPE) methods enable unbiased offline evaluation of recommender systems, directly estimating the online reward some target policy would have obtained, from offline data and with statistical guarante…

Lower Bounds on the Generalization Error of Nonlinear Learning Models

2021-03-26 · Inbar Seroussi, Ofer Zeitouni

We study in this paper lower bounds for the generalization error of models derived from multi-layer neural networks, in the regime where the size of the layers is commensurate with the number of samples in the training d…

regression