paper-with-me

Papers

Comparison between Suitable Priors for Additive Bayesian Networks

2018-09-18 · Gilles Kratzer, Reinhard Furrer, Marta Pittavino

Additive Bayesian networks are types of graphical models that extend the usual Bayesian generalized linear model to multiple dependent variables through the factorisation of the joint probability distribution of the underlying variables. When fitting an ABN model, the choice of the prior of the parameters is of crucial importance. If an inadequate prior - like a too weakly informative one - is used, data separation and data sparsity lead to issues in the model selection process. In this work a simulation study between two weakly and a strongly informative priors is presented. As weakly informative prior we use a zero mean Gaussian prior with a large variance, currently implemented in the R-package abn. The second prior belongs to the Student's t-distribution, specifically designed for logistic regressions and, finally, the strongly informative prior is again Gaussian with mean equal to true parameter value and a small variance. We compare the impact of these priors on the accuracy of the learned additive Bayesian network in function of different parameters. We create a simulation study to illustrate Lindley's paradox based on the prior choice. We then conclude by highlighting the good performance of the informative Student's t-prior and the limited impact of the Lindley's paradox. Finally, suggestions for further developments are provided.

📄 PDF Abstract BibTeX arXiv:1809.06636

Code (0)

등록된 구현이 없습니다.

Tasks

Model Selection

Similar Papers 제목 키워드 기반

Reconciling "priors" & "priors" without prejudice?

2013-12-01 · NeurIPS 2013 12 · Remi Gribonval, Pierre Machart

There are two major routes to address linear inverse problems. Whereas regularization-based approaches build estimators as solutions of penalized regression optimization problems, Bayesian estimators rely on the posterio…

Computational EfficiencyDenoisingregression

Two-sample comparison through additive tree models for density ratios

2025-08-05 · Naoki Awaya, Yuliang Xu, Li Ma arxiv

The ratio of two densities provides a direct characterization of their differences. We consider the two-sample comparison problem by estimating this ratio given i.i.d. observations from two distributions. To this end, we…

Computational EfficiencyBinary ClassificationBayesian Inference

GP-BART: a novel Bayesian additive regression trees approach using Gaussian processes

2022-04-05 · Mateus Maia, Keefe Murphy, Andrew C. Parnell

The Bayesian additive regression trees (BART) model is an ensemble method extensively and successfully used in regression tasks due to its consistently strong predictive performance and its ability to quantify uncertaint…

Gaussian Processesregression

Bayesian Sparse Factor Models and DAGs Inference and Comparison

2009-12-01 · NeurIPS 2009 12 · Ricardo Henao, Ole Winther

In this paper we present a novel approach to learn directed acyclic graphs (DAG) and factor models within the same framework while also allowing for model comparison between them. For this purpose, we exploit the connect…

valid

Bayesian Hierarchical Words Representation Learning

2020-04-12 · ACL 2020 6 · Oren Barkan, Idan Rejwan, Avi Caciularu, Noam Koenigstein

This paper presents the Bayesian Hierarchical Words Representation (BHWR) learning algorithm. BHWR facilitates Variational Bayes word representation learning combined with semantic taxonomy modeling via hierarchical prio…

Representation Learning