paper-with-me

홈 › Papers

Fast and robust Bayesian Inference using Gaussian Processes with GPry

2022-11-03 · Jonas El Gammal, Nils Schöneberg, Jesús Torrado, Christian Fidler

We present the GPry algorithm for fast Bayesian inference of general (non-Gaussian) posteriors with a moderate number of parameters. GPry does not need any pre-training, special hardware such as GPUs, and is intended as a drop-in replacement for traditional Monte Carlo methods for Bayesian inference. Our algorithm is based on generating a Gaussian Process surrogate model of the log-posterior, aided by a Support Vector Machine classifier that excludes extreme or non-finite values. An active learning scheme allows us to reduce the number of required posterior evaluations by two orders of magnitude compared to traditional Monte Carlo inference. Our algorithm allows for parallel evaluations of the posterior at optimal locations, further reducing wall-clock times. We significantly improve performance using properties of the posterior in our active learning scheme and for the definition of the GP prior. In particular we account for the expected dynamical range of the posterior in different dimensionalities. We test our model against a number of synthetic and cosmological examples. GPry outperforms traditional Monte Carlo methods when the evaluation time of the likelihood (or the calculation of theoretical observables) is of the order of seconds; for evaluation times of over a minute it can perform inference in days that would take months using traditional methods. GPry is distributed as an open source Python package (pip install gpry) and can also be found at https://github.com/jonaselgammal/GPry.

📄 PDF Abstract BibTeX arXiv:2211.02045

Code (1)

jonaselgammal/gpry 공식 구현

Tasks

Active LearningBayesian InferenceGaussian Processes

Methods 이 논문이 사용한 방법론

Test 설명 없음
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Fast Bayesian Inference for Gaussian Cox Processes via Path Integral Formulation

2021-12-01 · NeurIPS 2021 12 · Hideaki Kim

Gaussian Cox processes are widely-used point process models that use a Gaussian process to describe the Bayesian a priori uncertainty present in latent intensity functions. In this paper, we propose a novel Bayesian infe…

Bayesian Inference

Scalable Nonparametric Bayesian Inference on Point Processes with Gaussian Processes

2014-10-24 · Yves-Laurent Kom Samo, Stephen Roberts

In this paper we propose the first non-parametric Bayesian model using Gaussian Processes to make inference on Poisson Point Processes without resorting to gridding the domain or to introducing latent thinning points. Un…

Bayesian InferenceGaussian ProcessesPoint Processes

Fast Bayesian Inference for Non-Conjugate Gaussian Process Regression

2012-12-01 · NeurIPS 2012 12 · Emtiyaz Khan, Shakir Mohamed, Kevin P. Murphy

We present a new variational inference algorithm for Gaussian processes with non-conjugate likelihood functions. This includes binary and multi-class classification, as well as ordinal regression. Our method constructs a…

Bayesian InferenceGaussian ProcessesGeneral ClassificationMulti-class Classification+2

Variational Inference for Gaussian Process Modulated Poisson Processes

2014-11-02 · Chris Lloyd, Tom Gunter, Michael A. Osborne, Stephen J. Roberts

We present the first fully variational Bayesian inference scheme for continuous Gaussian-process-modulated Poisson processes. Such point processes are used in a variety of domains, including neuroscience, geo-statistics …

AstronomyBayesian InferencePoint ProcessesVariational Inference

GPatt: Fast Multidimensional Pattern Extrapolation with Gaussian Processes

2013-10-20 · Andrew Gordon Wilson, Elad Gilboa, Arye Nehorai, John P. Cunningham

Gaussian processes are typically used for smoothing and interpolation on small datasets. We introduce a new Bayesian nonparametric framework -- GPatt -- enabling automatic pattern extrapolation with Gaussian processes on…

Gaussian Processes