Sparse additive Gaussian process with soft interactions
Additive nonparametric regression models provide an attractive tool for variable selection in high dimensions when the relationship between the response and predictors is complex. They offer greater flexibility compared to parametric non-linear regression models and better interpretability and scalability than the non-parametric regression models. However, achieving sparsity simultaneously in the number of nonparametric components as well as in the variables within each nonparametric component poses a stiff computational challenge. In this article, we develop a novel Bayesian additive regression model using a combination of hard and soft shrinkages to separately control the number of additive components and the variables within each component. An efficient algorithm is developed to select the importance variables and estimate the interaction network. Excellent performance is obtained in simulated and real data examples.
Code (0)
등록된 구현이 없습니다.
Tasks
regressionVariable SelectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Additive Gaussian Processes Revisited
Gaussian Process (GP) models are a class of flexible non-parametric models that have rich representational power. By using a Gaussian process with additive structure, complex responses can be modelled whilst retaining in…
Gaussian ProcessesScalable GAM using sparse variational Gaussian processes
Generalized additive models (GAMs) are a widely used class of models of interest to statisticians as they provide a flexible way to design interpretable models of data beyond linear models. We here propose a scalable and…
Additive modelsGaussian ProcessesVariational InferenceRepresenting Additive Gaussian Processes by Sparse Matrices
Among generalized additive models, additive Mat\'ern Gaussian Processes (GPs) are one of the most popular for scalable high-dimensional problems. Thanks to their additive structure and stochastic differential equation re…
Additive modelsBayesian OptimizationGaussian ProcessesKernel Multigrid: Accelerate Back-fitting via Sparse Gaussian Process Regression
Additive Gaussian Processes (GPs) are popular approaches for nonparametric feature selection. The common training method for these models is Bayesian Back-fitting. However, the convergence rate of Back-fitting in trainin…
feature selectionGaussian ProcessesGPRregressionScalable Gaussian Process Classification with Additive Noise for Various Likelihoods
Gaussian process classification (GPC) provides a flexible and powerful statistical framework describing joint distributions over function space. Conventional GPCs however suffer from (i) poor scalability for big data due…
ClassificationGeneral ClassificationGPRMulti-class Classification+1