Matrix Inversion free variational inference in Conditional Student's T Processes
We propose a new variational lower bound for performing inference in sparse Student's T Processes that does not require computationally intensive operations such as matrix inversions or log determinants of matrices. We devise a mathematically valid and easy-to-sample from approximate posterior over the Inverse Wishart distributed covariance matrix encompassing both training data and inducing points. To deal with remaining log determinant terms we propose a conjugate gradient based lower bound that is tight when approximate posteriors are optimal. We demonstrate that our proposed model behaves similarly to matrix inversion dependent counterparts in terms of convergence of evidence lower bound and predictive capabilities at testing time on a wide array of toy experiments. Moreover, we test the validity of our method on medium and large scale datasets, showing encouraging results.
Code (0)
등록된 구현이 없습니다.
Tasks
validVariational InferenceSimilar Papers 제목 키워드 기반
An inner-loop free solution to inverse problems using deep neural networks
We propose a new method that uses deep learning techniques to accelerate the popular alternating direction method of multipliers (ADMM) solution for inverse problems. The ADMM updates consist of a proximity operator, a l…
DenoisingVariational Gaussian Process Models without Matrix Inverses
Large matrix inversions have often been cited as a major impediment to scaling Gaussian process (GP) models. With the use of GPs as building blocks for ever more sophisticated Bayesian deep learning models, removing thes…
WISE: full-Waveform variational Inference via Subsurface Extensions
We introduce a probabilistic technique for full-waveform inversion, employing variational inference and conditional normalizing flows to quantify uncertainty in migration-velocity models and its impact on imaging. Our ap…
Variational InferenceInversion-Free Natural Gradient Descent on Riemannian Manifolds
The natural gradient method is a central tool for statistical optimisation, but its broader application is hindered by the assumption of a Euclidean parameter space, the repeated estimation of the Fisher information matr…
AutoBayes: A Compositional Framework for Generalized Variational Inference
We introduce a new compositional framework for generalized variational inference, clarifying the different parts of a model, how they interact, and how they compose. We explain that both exact Bayesian inference and the …
Bayesian InferenceVariational Inference