Multilevel Gibbs Sampling for Bayesian Regression
Bayesian regression remains a simple but effective tool based on Bayesian inference techniques. For large-scale applications, with complicated posterior distributions, Markov Chain Monte Carlo methods are applied. To improve the well-known computational burden of Markov Chain Monte Carlo approach for Bayesian regression, we developed a multilevel Gibbs sampler for Bayesian regression of linear mixed models. The level hierarchy of data matrices is created by clustering the features and/or samples of data matrices. Additionally, the use of correlated samples is investigated for variance reduction to improve the convergence of the Markov Chain. Testing on a diverse set of data sets, speed-up is achieved for almost all of them without significant loss in predictive performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceClusteringregressionSimilar Papers 제목 키워드 기반
bqror: An R package for Bayesian Quantile Regression in Ordinal Models
This article describes an R package bqror that estimates Bayesian quantile regression for ordinal models introduced in Rahman (2016). The paper classifies ordinal models into two types and offers computationally efficien…
quantile regressionregressionFrom Estimation to Sampling for Bayesian Linear Regression with Spike-and-Slab Prior
We consider Bayesian linear regression with sparsity-inducing prior and design efficient sampling algorithms leveraging posterior contraction properties. A quasi-likelihood with Gaussian spike-and-slab (that is favorable…
regressionvalidSampling from Constrained Gibbs Measures: with Applications to High-Dimensional Bayesian Inference
This paper considers a non-standard problem of generating samples from a low-temperature Gibbs distribution with \emph{constrained} support, when some of the coordinates of the mode lie on the boundary. These coordinates…
Bayesian InferenceModulation Classification via Gibbs Sampling Based on a Latent Dirichlet Bayesian Network
A novel Bayesian modulation classification scheme is proposed for a single-antenna system over frequency-selective fading channels. The method is based on Gibbs sampling as applied to a latent Dirichlet Bayesian network …
ClassificationGeneral ClassificationA Bayesian Lasso based Sparse Learning Model
The Bayesian Lasso is constructed in the linear regression framework and applies the Gibbs sampling to estimate the regression parameters. This paper develops a new sparse learning model, named the Bayesian Lasso Sparse …
Compressive SensingmodelregressionSparse Learning