paper-with-me

Papers

Graphical posterior predictive classifier: Bayesian model averaging with particle Gibbs

2017-07-21 · Tatjana Pavlenko, Felix Leopoldo Rios

In this study, we present a multi-class graphical Bayesian predictive classifier that incorporates the uncertainty in the model selection into the standard Bayesian formalism. For each class, the dependence structure underlying the observed features is represented by a set of decomposable Gaussian graphical models. Emphasis is then placed on the Bayesian model averaging which takes full account of the class-specific model uncertainty by averaging over the posterior graph model probabilities. An explicit evaluation of the model probabilities is well known to be infeasible. To address this issue, we consider the particle Gibbs strategy of Olsson et al. (2018b) for posterior sampling from decomposable graphical models which utilizes the Christmas tree algorithm of Olsson et al. (2018a) as proposal kernel. We also derive a strong hyper Markov law which we call the hyper normal Wishart law that allow to perform the resultant Bayesian calculations locally. The proposed predictive graphical classifier reveals superior performance compared to the ordinary Bayesian predictive rule that does not account for the model uncertainty, as well as to a number of out-of-the-box classifiers.

📄 PDF Abstract BibTeX arXiv:1707.06792

Code (1)

felixleopoldo/trilearn

Tasks

Model Selection

Similar Papers 제목 키워드 기반

Marginal and simultaneous predictive classification using stratified graphical models

2014-01-31 · Henrik Nyman, Jie Xiong, Johan Pensar, Jukka Corander

An inductive probabilistic classification rule must generally obey the principles of Bayesian predictive inference, such that all observed and unobserved stochastic quantities are jointly modeled and the parameter uncert…

ClassificationGeneral Classification

Learning under Model Misspecification: Applications to Variational and Ensemble methods

2019-12-18 · NeurIPS 2020 12 · Andres R. Masegosa

Virtually any model we use in machine learning to make predictions does not perfectly represent reality. So, most of the learning happens under model misspecification. In this work, we present a novel analysis of the gen…

Bayesian Model Averaging under Predictor Redundancy via Density-Ratio Posterior Compression

2026-06-19 · Hanqing Li, Xuewen Lu, Yuting Chen arxiv

Bayesian model averaging in support-indexed regression induces a posterior distribution over active predictor supports. Under predictor redundancy, posterior mass can spread across many nearly interchangeable supports, m…

FBMS: An R Package for Flexible Bayesian Model Selection and Model Averaging

2025-08-31 · Florian Frommlet, Jon Lachmann, Geir Storvik, Aliaksandr Hubin arxiv

The FBMS R package facilitates Bayesian model selection and model averaging in complex regression settings by employing a variety of Monte Carlo model exploration methods. At its core, the package implements an efficient…

Depth induces scale-averaging in overparameterized linear Bayesian neural networks

2021-11-23 · Jacob A. Zavatone-Veth, Cengiz Pehlevan

Inference in deep Bayesian neural networks is only fully understood in the infinite-width limit, where the posterior flexibility afforded by increased depth washes out and the posterior predictive collapses to a shallow …

Representation Learning