paper-with-me

Papers

Matrix Inversion free variational inference in Conditional Student's T Processes

2021-11-22 · pproximateinference AABI Symposium 2022 2 · Sebastian Popescu, Ben Glocker, Mark van der Wilk

We propose a new variational lower bound for performing inference in sparse Student's T Processes that does not require computationally intensive operations such as matrix inversions or log determinants of matrices. We devise a mathematically valid and easy-to-sample from approximate posterior over the Inverse Wishart distributed covariance matrix encompassing both training data and inducing points. To deal with remaining log determinant terms we propose a conjugate gradient based lower bound that is tight when approximate posteriors are optimal. We demonstrate that our proposed model behaves similarly to matrix inversion dependent counterparts in terms of convergence of evidence lower bound and predictive capabilities at testing time on a wide array of toy experiments. Moreover, we test the validity of our method on medium and large scale datasets, showing encouraging results.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

validVariational Inference

Similar Papers 제목 키워드 기반

An inner-loop free solution to inverse problems using deep neural networks

2017-09-06 · NeurIPS 2017 12 · Qi Wei, Kai Fan, Lawrence Carin, Katherine A. Heller

We propose a new method that uses deep learning techniques to accelerate the popular alternating direction method of multipliers (ADMM) solution for inverse problems. The ADMM updates consist of a proximity operator, a l…

Denoising

Variational Gaussian Process Models without Matrix Inverses

2019-10-16 · pproximateinference AABI Symposium 2019 12 · Mark van der Wilk, ST John, Artem Artemev, James Hensman

Large matrix inversions have often been cited as a major impediment to scaling Gaussian process (GP) models. With the use of GPs as building blocks for ever more sophisticated Bayesian deep learning models, removing thes…

WISE: full-Waveform variational Inference via Subsurface Extensions

2023-12-11 · Ziyi Yin, Rafael Orozco, Mathias Louboutin, Felix J. Herrmann

We introduce a probabilistic technique for full-waveform inversion, employing variational inference and conditional normalizing flows to quantify uncertainty in migration-velocity models and its impact on imaging. Our ap…

Variational Inference

Inversion-Free Natural Gradient Descent on Riemannian Manifolds

2026-04-03 · Dario Draca, Takuo Matsubara, Minh-Ngoc Tran arxiv

The natural gradient method is a central tool for statistical optimisation, but its broader application is hindered by the assumption of a Euclidean parameter space, the repeated estimation of the Fisher information matr…

AutoBayes: A Compositional Framework for Generalized Variational Inference

2025-03-24 · Toby St Clere Smithe, Marco Perin

We introduce a new compositional framework for generalized variational inference, clarifying the different parts of a model, how they interact, and how they compose. We explain that both exact Bayesian inference and the …

Bayesian InferenceVariational Inference