Bayesian Numerical Integration with Neural Networks
Bayesian probabilistic numerical methods for numerical integration offer significant advantages over their non-Bayesian counterparts: they can encode prior information about the integrand, and can quantify uncertainty over estimates of an integral. However, the most popular algorithm in this class, Bayesian quadrature, is based on Gaussian process models and is therefore associated with a high computational cost. To improve scalability, we propose an alternative approach based on Bayesian neural networks which we call Bayesian Stein networks. The key ingredients are a neural network architecture based on Stein operators, and an approximation of the Bayesian posterior based on the Laplace approximation. We show that this leads to orders of magnitude speed-ups on the popular Genz functions benchmark, and on challenging problems arising in the Bayesian analysis of dynamical systems, and the prediction of energy production for a large-scale wind farm.
Code (1)
Tasks
Numerical IntegrationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bayesian Probabilistic Numerical Integration with Tree-Based Models
Bayesian quadrature (BQ) is a method for solving numerical integration problems in a Bayesian manner, which allows users to quantify their uncertainty about the solution. The standard approach to BQ is based on a Gaussia…
Numerical IntegrationActive Learning of Model Evidence Using Bayesian Quadrature
Numerical integration is an key component of many problems in scientific computing, statistical modelling, and machine learning. Bayesian Quadrature is a model-based method for numerical integration which, relative to st…
Active LearningAstronomymodelNumerical IntegrationBayesian Quadrature: Gaussian Processes for Integration
Bayesian quadrature is a probabilistic, model-based approach to numerical integration, the estimation of intractable integrals, or expectations. Although Bayesian quadrature was popularised already in the 1980s, no syste…
Gaussian ProcessesInvariant Priors for Bayesian Quadrature
Bayesian quadrature (BQ) is a model-based numerical integration method that is able to increase sample efficiency by encoding and leveraging known structure of the integration task at hand. In this paper, we explore prio…
Numerical IntegrationFast Bayesian Inference with Batch Bayesian Quadrature via Kernel Recombination
Calculation of Bayesian posteriors and model evidences typically requires numerical integration. Bayesian quadrature (BQ), a surrogate-model-based approach to numerical integration, is capable of superb sample efficiency…
Bayesian InferenceNumerical Integration