paper-with-me

Papers

Stochastic Collapsed Variational Inference for Structured Gaussian Process Regression Network

2021-06-01 · Rui Meng, Herbie Lee, Kristofer Bouchard

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and jointly treats both the distributions of the inducing variables and hyper-parameters as variational parameters. Then we propose structured variable distributions and marginalize latent variables, which enables the decomposability of a tractable variational lower bound and leads to stochastic optimization. Our inference approach is able to model data in which outputs do not share a common input set with a computational complexity independent of the size of the inputs and outputs and thus easily handle datasets with missing values. We illustrate the performance of our method on synthetic data and real datasets and show that our model generally provides better imputation results on missing data than the state-of-the-art. We also provide a visualization approach for time-varying correlation across outputs in electrocoticography data and those estimates provide insight to understand the neural population dynamics.

📄 PDF Abstract BibTeX arXiv:2106.00719

Code (0)

등록된 구현이 없습니다.

Tasks

ImputationMissing ValuesregressionStochastic OptimizationVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Stochastic Collapsed Variational Inference for Sequential Data

2015-12-05 · Pengyu Wang, Phil Blunsom

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm in the sequent…

Variational Inference

Practical Collapsed Stochastic Variational Inference for the HDP

2013-12-02 · Arnim Bleier

Recent advances have made it feasible to apply the stochastic variational paradigm to a collapsed representation of latent Dirichlet allocation (LDA). While the stochastic variational paradigm has successfully been appli…

Variational Inference

Stochastic Collapsed Variational Inference for Hidden Markov Models

2015-12-05 · Pengyu Wang, Phil Blunsom

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm for hidden Mar…

Variational Inference

Stochastic Collapsed Variational Bayesian Inference for Latent Dirichlet Allocation

2013-05-10 · James Foulds, Levi Boyles, Christopher DuBois, Padhraic Smyth 외

In the internet era there has been an explosion in the amount of digital text information available, leading to difficulties of scale for traditional inference algorithms for topic models. Recent advances in stochastic v…

Bayesian InferenceTopic ModelsVariational Inference

Structured Bayesian Gaussian process latent variable model

2018-05-22 · Steven Atkinson, Nicholas Zabaras

We introduce a Bayesian Gaussian process latent variable model that explicitly captures spatial correlations in data using a parameterized spatial kernel and leveraging structure-exploiting algebra on the model covarianc…

ImputationmodelSuper-ResolutionTime Series+1