paper-with-me

Papers

Factorized Gaussian Process Variational Autoencoders

2020-11-14 · pproximateinference AABI Symposium 2021 1 · Metod Jazbec, Michael Pearce, Vincent Fortuin

Variational autoencoders often assume isotropic Gaussian priors and mean-field posteriors, hence do not exploit structure in scenarios where we may expect similarity or consistency across latent variables. Gaussian process variational autoencoders alleviate this problem through the use of a latent Gaussian process, but lead to a cubic inference time complexity. We propose a more scalable extension of these models by leveraging the independence of the auxiliary features, which is present in many datasets. Our model factorizes the latent kernel across these features in different dimensions, leading to a significant speed-up (in theory and practice), while empirically performing comparably to existing non-scalable approaches. Moreover, our approach allows for additional modeling of global latent information and for more general extrapolation to unseen input combinations.

📄 PDF Abstract BibTeX arXiv:2011.07255

Code (1)

metodj/FGP-VAE 공식 구현 tf

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Scalable Gaussian Process Variational Autoencoders

2020-10-26 · Metod Jazbec, Matthew Ashman, Vincent Fortuin, Michael Pearce 외

Conventional variational autoencoders fail in modeling correlations between data points due to their use of factorized priors. Amortized Gaussian process inference through GP-VAEs has led to significant improvements in t…

Variational Laplace Autoencoders

2022-11-30 · Yookoon Park, Chris Dongjoo Kim, Gunhee Kim

Variational autoencoders employ an amortized inference model to approximate the posterior of latent variables. However, such amortized variational inference faces two challenges: (1) the limited posterior expressiveness …

Variational Inference

Tightening Bounds for Variational Inference by Revisiting Perturbation Theory

2019-09-30 · Robert Bamler, Cheng Zhang, Manfred Opper, Stephan Mandt

Variational inference has become one of the most widely used methods in latent variable modeling. In its basic form, variational inference employs a fully factorized variational distribution and minimizes its KL divergen…

Gaussian ProcessesStochastic OptimizationvalidVariational Inference

The advantage of using Student's t-priors in variational autoencoders

2019-09-25 · Najmeh Abiri, Mattias Ohlsson

Is it optimal to use the standard Gaussian prior in variational autoencoders? With Gaussian distributions, which are not weakly informative priors, variational autoencoders struggle to reconstruct the actual data. We pro…

Dynamic Variational Autoencoders for Visual Process Modeling

2018-03-20 · Alexander Sagel, Hao Shen

This work studies the problem of modeling visual processes by leveraging deep generative architectures for learning linear, Gaussian representations from observed sequences. We propose a joint learning framework, combini…