paper-with-me

Papers

A Semi-Parametric Bayesian Generalized Least Squares Estimator

2020-11-20 · Ruochen Wu, Melvyn Weeks

In this paper we propose a semi-parametric Bayesian Generalized Least Squares estimator. In a generic setting where each error is a vector, the parametric Generalized Least Square estimator maintains the assumption that each error vector has the same distributional parameters. In reality, however, errors are likely to be heterogeneous regarding their distributions. To cope with such heterogeneity, a Dirichlet process prior is introduced for the distributional parameters of the errors, leading to the error distribution being a mixture of a variable number of normal distributions. Our method let the number of normal components be data driven. Semi-parametric Bayesian estimators for two specific cases are then presented: the Seemingly Unrelated Regression for equation systems and the Random Effects Model for panel data. We design a series of simulation experiments to explore the performance of our estimators. The results demonstrate that our estimators obtain smaller posterior standard deviations and mean squared errors than the Bayesian estimators using a parametric mixture of normal distributions or a normal distribution. We then apply our semi-parametric Bayesian estimators for equation systems and panel data models to empirical data.

📄 PDF Abstract BibTeX arXiv:2011.10252

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Weighted-Average Least Squares for Negative Binomial Regression

2024-04-17 · Kevin Huynh

Model averaging methods have become an increasingly popular tool for improving predictions and dealing with model uncertainty, especially in Bayesian settings. Recently, frequentist model averaging methods such as inform…

regression

Learning Linear Dynamical Systems with Semi-Parametric Least Squares

2019-02-02 · Max Simchowitz, Ross Boczar, Benjamin Recht

We analyze a simple prefiltered variation of the least squares estimator for the problem of estimation with biased, semi-parametric noise, an error model studied more broadly in causal statistics and active learning. We …

Active Learning

From Adaptive Kernel Density Estimation to Sparse Mixture Models

2018-12-11 · Colas Schretter, Jianyong Sun, Peter Schelkens

We introduce a balloon estimator in a generalized expectation-maximization method for estimating all parameters of a Gaussian mixture model given one data sample per mixture component. Instead of limiting explicitly the …

Density Estimation

Optimal prediction for kernel-based semi-functional linear regression

2021-10-29 · Keli Guo, Jun Fan, Lixing Zhu

In this paper, we establish minimax optimal rates of convergence for prediction in a semi-functional linear model that consists of a functional component and a less smooth nonparametric component. Our results reveal that…

Predictionregression

Deep Neural Networks for Estimation and Inference

2018-09-26 · Max H. Farrell, Tengyuan Liang, Sanjog Misra

We study deep neural networks and their use in semiparametric inference. We establish novel rates of convergence for deep feedforward neural nets. Our new rates are sufficiently fast (in some cases minimax optimal) to al…

Marketingregressionvalid