Global Approximate Inference via Local Linearisation for Temporal Gaussian Processes
The extended Kalman filter (EKF) is a classical signal processing algorithm which performs efficient approximate Bayesian inference in non-conjugate models by linearising the local measurement function, avoiding the need to compute intractable integrals when calculating the posterior. In some cases the EKF outperforms methods which rely on cubature to solve such integrals, especially in time-critical real-world problems. The drawback of the EKF is its local nature, whereas state-of-the-art methods such as variational inference or expectation propagation (EP) are considered global approximations. We formulate power EP as a nonlinear Kalman filter, before showing that linearisation results in a globally iterated algorithm that exactly matches the EKF on the first pass through the data, and iteratively improves the linearisation on subsequent passes. An additional benefit is the ability to calculate the limit as the EP power tends to zero, which removes the instability of the EP-like algorithm. The resulting inference scheme solves non-conjugate temporal Gaussian process models in linear time, $\mathcal{O}(n)$, and in closed form.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceGaussian ProcessesVariational InferenceSimilar Papers 제목 키워드 기반
State Space Expectation Propagation: Efficient Inference Schemes for Temporal Gaussian Processes
We formulate approximate Bayesian inference in non-conjugate temporal and spatio-temporal Gaussian process models as a simple parameter update rule applied during Kalman smoothing. This viewpoint encompasses most inferen…
Bayesian InferenceComputational EfficiencyGaussian ProcessesVariational InferenceGaussian process classification using posterior linearisation
This paper proposes a new algorithm for Gaussian process classification based on posterior linearisation (PL). In PL, a Gaussian approximation to the posterior density is obtained iteratively using the best possible line…
ClassificationGeneral ClassificationChained Gaussian Processes
Gaussian process models are flexible, Bayesian non-parametric approaches to regression. Properties of multivariate Gaussians mean that they can be combined linearly in the manner of additive models and via a link functio…
Additive modelsGaussian ProcessesBayes-Newton Methods for Approximate Bayesian Inference with PSD Guarantees
We formulate natural gradient variational inference (VI), expectation propagation (EP), and posterior linearisation (PL) as extensions of Newton's method for optimising the parameters of a Bayesian posterior distribution…
Bayesian InferenceGaussian ProcessesState Space Modelsvalid+1Equivariant Filter (EqF)
The kinematics of many systems encountered in robotics, mechatronics, and avionics are naturally posed on homogeneous spaces, that is, their state lies in a smooth manifold equipped with a transitive Lie group symmetry. …