Bayesian optimisation for fast approximate inference in state-space models with intractable likelihoods
We consider the problem of approximate Bayesian parameter inference in non-linear state-space models with intractable likelihoods. Sequential Monte Carlo with approximate Bayesian computations (SMC-ABC) is one approach to approximate the likelihood in this type of models. However, such approximations can be noisy and computationally costly which hinders efficient implementations using standard methods based on optimisation and Monte Carlo methods. We propose a computationally efficient novel method based on the combination of Gaussian process optimisation and SMC-ABC to create a Laplace approximation of the intractable posterior. We exemplify the proposed algorithm for inference in stochastic volatility models with both synthetic and real-world data as well as for estimating the Value-at-Risk for two portfolios using a copula model. We document speed-ups of between one and two orders of magnitude compared to state-of-the-art algorithms for posterior inference.
Code (2)
Tasks
Bayesian OptimisationState Space ModelsSimilar Papers 제목 키워드 기반
Fast Information-theoretic Bayesian Optimisation
Information-theoretic Bayesian optimisation techniques have demonstrated state-of-the-art performance in tackling important global optimisation problems. However, current information-theoretic approaches require many app…
Bayesian OptimisationRobust Optimisation Monte Carlo
This paper is on Bayesian inference for parametric statistical models that are defined by a stochastic simulator which specifies how data is generated. Exact sampling is then possible but evaluating the likelihood functi…
Bayesian InferenceBayes-Newton Methods for Approximate Bayesian Inference with PSD Guarantees
We formulate natural gradient variational inference (VI), expectation propagation (EP), and posterior linearisation (PL) as extensions of Newton's method for optimising the parameters of a Bayesian posterior distribution…
Bayesian InferenceGaussian ProcessesState Space Modelsvalid+1Distributional Bayesian optimisation for variational inference on black-box simulators
Inverse problems are ubiquitous in natural sciences and refer to the challenging task of inferring complex and potentially multi-modal posterior distributions over hidden parameters given a set of observations. Typically…
Bayesian OptimisationVariational InferenceApproximate Bayesian Optimisation for Neural Networks
A body of work has been done to automate machine learning algorithm to highlight the importance of model choice. Automating the process of choosing the best forecasting model and its corresponding parameters can result t…
Bayesian OptimisationDensity Ratio EstimationGaussian Processes