paper-with-me

Papers

Global Approximate Inference via Local Linearisation for Temporal Gaussian Processes

2019-10-16 · pproximateinference AABI Symposium 2019 12 · William J. Wilkinson, Paul E. Chang, Michael Riis Andersen, Arno Solin

The extended Kalman filter (EKF) is a classical signal processing algorithm which performs efficient approximate Bayesian inference in non-conjugate models by linearising the local measurement function, avoiding the need to compute intractable integrals when calculating the posterior. In some cases the EKF outperforms methods which rely on cubature to solve such integrals, especially in time-critical real-world problems. The drawback of the EKF is its local nature, whereas state-of-the-art methods such as variational inference or expectation propagation (EP) are considered global approximations. We formulate power EP as a nonlinear Kalman filter, before showing that linearisation results in a globally iterated algorithm that exactly matches the EKF on the first pass through the data, and iteratively improves the linearisation on subsequent passes. An additional benefit is the ability to calculate the limit as the EP power tends to zero, which removes the instability of the EP-like algorithm. The resulting inference scheme solves non-conjugate temporal Gaussian process models in linear time, $\mathcal{O}(n)$, and in closed form.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian InferenceGaussian ProcessesVariational Inference

Similar Papers 제목 키워드 기반

State Space Expectation Propagation: Efficient Inference Schemes for Temporal Gaussian Processes

2020-07-12 · ICML 2020 1 · William J. Wilkinson, Paul E. Chang, Michael Riis Andersen, Arno Solin

We formulate approximate Bayesian inference in non-conjugate temporal and spatio-temporal Gaussian process models as a simple parameter update rule applied during Kalman smoothing. This viewpoint encompasses most inferen…

Bayesian InferenceComputational EfficiencyGaussian ProcessesVariational Inference

Gaussian process classification using posterior linearisation

2018-09-13 · Ángel F. García-Fernández, Filip Tronarp, Simo Särkkä

This paper proposes a new algorithm for Gaussian process classification based on posterior linearisation (PL). In PL, a Gaussian approximation to the posterior density is obtained iteratively using the best possible line…

ClassificationGeneral Classification

Chained Gaussian Processes

2016-04-18 · Alan D. Saul, James Hensman, Aki Vehtari, Neil D. Lawrence

Gaussian process models are flexible, Bayesian non-parametric approaches to regression. Properties of multivariate Gaussians mean that they can be combined linearly in the manner of additive models and via a link functio…

Additive modelsGaussian Processes

Bayes-Newton Methods for Approximate Bayesian Inference with PSD Guarantees

2021-11-02 · William J. Wilkinson, Simo Särkkä, Arno Solin

We formulate natural gradient variational inference (VI), expectation propagation (EP), and posterior linearisation (PL) as extensions of Newton's method for optimising the parameters of a Bayesian posterior distribution…

Bayesian InferenceGaussian ProcessesState Space Modelsvalid+1

Equivariant Filter (EqF)

2020-10-27 · Pieter van Goor, Tarek Hamel, Robert Mahony

The kinematics of many systems encountered in robotics, mechatronics, and avionics are naturally posed on homogeneous spaces, that is, their state lies in a smooth manifold equipped with a transitive Lie group symmetry. …