paper-with-me

Papers

Robust Generalised Bayesian Inference for Intractable Likelihoods

2021-04-15 · Takuo Matsubara, Jeremias Knoblauch, François-Xavier Briol, Chris. J. Oates

Generalised Bayesian inference updates prior beliefs using a loss function, rather than a likelihood, and can therefore be used to confer robustness against possible mis-specification of the likelihood. Here we consider generalised Bayesian inference with a Stein discrepancy as a loss function, motivated by applications in which the likelihood contains an intractable normalisation constant. In this context, the Stein discrepancy circumvents evaluation of the normalisation constant and produces generalised posteriors that are either closed form or accessible using standard Markov chain Monte Carlo. On a theoretical level, we show consistency, asymptotic normality, and bias-robustness of the generalised posterior, highlighting how these properties are impacted by the choice of Stein discrepancy. Then, we provide numerical experiments on a range of intractable distributions, including applications to kernel-based exponential family models and non-Gaussian graphical models.

📄 PDF Abstract BibTeX arXiv:2104.07359

Code (1)

takuomatsubara/KSD-Bayes 공식 구현

Tasks

Bayesian Inference

Similar Papers 제목 키워드 기반

Generalised Bayesian Inference for Discrete Intractable Likelihood

2022-06-16 · Takuo Matsubara, Jeremias Knoblauch, François-Xavier Briol, Chris. J. Oates

Discrete state spaces represent a major computational challenge to statistical inference, since the computation of normalisation constants requires summation over large or possibly infinite sets, which can be impractical…

Bayesian Inference

Bayesian optimisation for fast approximate inference in state-space models with intractable likelihoods

2015-06-23 · Johan Dahlin, Mattias Villani, Thomas B. Schön

We consider the problem of approximate Bayesian parameter inference in non-linear state-space models with intractable likelihoods. Sequential Monte Carlo with approximate Bayesian computations (SMC-ABC) is one approach t…

Bayesian OptimisationState Space Models

Optimal simulation-based Bayesian decisions

2023-11-09 · Justin Alsing, Thomas D. P. Edwards, Benjamin Wandelt

We present a framework for the efficient computation of optimal Bayesian decisions under intractable likelihoods, by learning a surrogate model for the expected utility (or its distribution) as a function of the action a…

Active LearningBayesian OptimizationDecision Making

Variational Bayesian Monte Carlo

2018-10-12 · NeurIPS 2018 12 · Luigi Acerbi

Many probabilistic models of interest in scientific computing and machine learning have expensive, black-box likelihoods that prevent the application of standard techniques for Bayesian inference, such as MCMC, which wou…

Bayesian InferenceModel SelectionVariational Inference

Correcting Mode Proportion Bias in Generalized Bayesian Inference via a Weighted Kernel Stein Discrepancy

2025-03-03 · Elham Afzali, Saman Muthukumarana, Liqun Wang

Generalized Bayesian Inference (GBI) provides a flexible framework for updating prior distributions using various loss functions instead of the traditional likelihoods, thereby enhancing the model robustness to model mis…

Bayesian InferenceComputational Efficiency