paper-with-me

Papers

Structured Bayesian Gaussian process latent variable model: applications to data-driven dimensionality reduction and high-dimensional inversion

2018-07-11 · Steven Atkinson, Nicholas Zabaras

We introduce a methodology for nonlinear inverse problems using a variational Bayesian approach where the unknown quantity is a spatial field. A structured Bayesian Gaussian process latent variable model is used both to construct a low-dimensional generative model of the sample-based stochastic prior as well as a surrogate for the forward evaluation. Its Bayesian formulation captures epistemic uncertainty introduced by the limited number of input and output examples, automatically selects an appropriate dimensionality for the learned latent representation of the data, and rigorously propagates the uncertainty of the data-driven dimensionality reduction of the stochastic space through the forward model surrogate. The structured Gaussian process model explicitly leverages spatial information for an informative generative prior to improve sample efficiency while achieving computational tractability through Kronecker product decompositions of the relevant kernel matrices. Importantly, the Bayesian inversion is carried out by solving a variational optimization problem, replacing traditional computationally-expensive Monte Carlo sampling. The methodology is demonstrated on an elliptic PDE and is shown to return well-calibrated posteriors and is tractable with latent spaces with over 100 dimensions.

📄 PDF Abstract BibTeX arXiv:1807.04302

Code (1)

cics-nd/sgplvm-inverse 공식 구현 tf

Tasks

Dimensionality Reduction

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Structured Bayesian Gaussian process latent variable model

2018-05-22 · Steven Atkinson, Nicholas Zabaras

We introduce a Bayesian Gaussian process latent variable model that explicitly captures spatial correlations in data using a parameterized spatial kernel and leveraging structure-exploiting algebra on the model covarianc…

ImputationmodelSuper-ResolutionTime Series+1

Gaussian Process Latent Variable Flows for Massively Missing Data

2020-11-23 · pproximateinference AABI Symposium 2021 1 · Vidhi Lalchand, Aditya Ravuri, Neil D Lawrence

Gaussian process latent variable models (GPLVM) are used to perform nonlinear and probabilistic dimensionality reduction. They extend Gaussian processes (GP) to the domain of unsupervised learning. The Bayesian incarnati…

Dimensionality ReductionGaussian ProcessesNormalising FlowsVariational Inference

Beta Process Non-negative Matrix Factorization with Stochastic Structured Mean-Field Variational Inference

2014-11-07 · Dawen Liang, Matthew D. Hoffman

Beta process is the standard nonparametric Bayesian prior for latent factor model. In this paper, we derive a structured mean-field variational inference algorithm for a beta process non-negative matrix factorization (NM…

Variational Inference

Monte Carlo Structured SVI for Two-Level Non-Conjugate Models

2016-12-12 · Rishit Sheth, Roni Khardon

The stochastic variational inference (SVI) paradigm, which combines variational inference, natural gradients, and stochastic updates, was recently proposed for large-scale data analysis in conjugate Bayesian models and d…

Gaussian ProcessesTopic ModelsVariational InferenceVocal Bursts Valence Prediction

Multi-view Bayesian optimisation in reduced dimension for engineering design

2025-01-02 · Thomas A. Archbold, Ieva Kazlauskaite, Fehmi Cirak

Bayesian optimisation is an adaptive sampling strategy for constructing a Gaussian process surrogate to emulate a black-box computational model with the aim of efficiently searching for the global minimum. However, Gauss…

Bayesian OptimisationGaussian ProcessesMULTI-VIEW LEARNING