A Sparse Grid Approach for the Nonparametric Estimation of High-Dimensional Random Coefficient Models
A severe limitation of many nonparametric estimators for random coefficient models is the exponential increase of the number of parameters in the number of random coefficients included into the model. This property, known as the curse of dimensionality, restricts the application of such estimators to models with moderately few random coefficients. This paper proposes a scalable nonparametric estimator for high-dimensional random coefficient models. The estimator uses a truncated tensor product of one-dimensional hierarchical basis functions to approximate the underlying random coefficients' distribution. Due to the truncation, the number of parameters increases at a much slower rate than in the regular tensor product basis, rendering the nonparametric estimation of high-dimensional random coefficient models feasible. The derived estimator allows estimating the underlying distribution with constrained least squares, making the approach computationally simple and fast. Monte Carlo experiments and an application to data on the regulation of air pollution illustrate the good performance of the estimator.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Sparse deep neural networks for nonparametric estimation in high-dimensional sparse regression
Generalization theory has been established for sparse deep neural networks under high-dimensional regime. Beyond generalization, parameter estimation is also important since it is crucial for variable selection and inter…
parameter estimationregressionVariable SelectionNonparametric Greedy Algorithms for the Sparse Learning Problem
This paper studies the forward greedy strategy in sparse nonparametric regression. For additive models, we propose an algorithm called additive forward regression; for general multivariate regression, we propose an algor…
Additive modelsregressionSparse LearningVariable SelectionNonparametric Empirical Bayes Estimation and Testing for Sparse and Heteroscedastic Signals
Large-scale modern data often involves estimation and testing for high-dimensional unknown parameters. It is desirable to identify the sparse signals, ``the needles in the haystack'', with accuracy and false discovery co…
Uncertainty QuantificationEstimation and Uniform Inference in Sparse High-Dimensional Additive Models
We develop a novel method to construct uniformly valid confidence bands for a nonparametric component $f_1$ in the sparse additive model $Y=f_1(X_1)+\ldots + f_p(X_p) + \varepsilon$ in a high-dimensional setting. Our met…
Additive modelsvalidVocal Bursts Intensity PredictionSparse-Input Neural Networks for High-dimensional Nonparametric Regression and Classification
Neural networks are usually not the tool of choice for nonparametric high-dimensional problems where the number of input features is much larger than the number of observations. Though neural networks can approximate com…
General ClassificationregressionVocal Bursts Intensity Prediction