paper-with-me

Papers

Embarrassingly Parallel Inference for Gaussian Processes

2017-02-27 · Michael Minyi Zhang, Sinead A. Williamson

Training Gaussian process-based models typically involves an $ O(N^3)$ computational bottleneck due to inverting the covariance matrix. Popular methods for overcoming this matrix inversion problem cannot adequately model all types of latent functions, and are often not parallelizable. However, judicious choice of model structure can ameliorate this problem. A mixture-of-experts model that uses a mixture of $K$ Gaussian processes offers modeling flexibility and opportunities for scalable inference. Our embarrassingly parallel algorithm combines low-dimensional matrix inversions with importance sampling to yield a flexible, scalable mixture-of-experts model that offers comparable performance to Gaussian process regression at a much lower computational cost.

📄 PDF Abstract BibTeX arXiv:1702.08420

Code (1)

michaelzhang01/ISMOE 공식 구현

Tasks

Gaussian ProcessesMixture-of-Expertsregression

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

A Fast Kernel-based Conditional Independence test with Application to Causal Discovery

2025-05-16 · Oliver Schacht, Biwei Huang

Kernel-based conditional independence (KCI) testing is a powerful nonparametric method commonly employed in causal discovery tasks. Despite its flexibility and statistical reliability, cubic computational complexity limi…

Causal DiscoveryCausal InferenceGaussian ProcessesMixture-of-Experts

Embarrassingly Parallel Variational Inference in Nonconjugate Models

2015-10-14 · Willie Neiswanger, Chong Wang, Eric Xing

We develop a parallel variational inference (VI) procedure for use in data-distributed settings, where each machine only has access to a subset of data and runs VI independently, without communicating with other machines…

Variational Inference

Distributed Bayesian Matrix Factorization with Limited Communication

2017-03-02 · Xiangju Qin, Paul Blomstedt, Eemeli Leppäaho, Pekka Parviainen 외

Bayesian matrix factorization (BMF) is a powerful tool for producing low-rank representations of matrices and for predicting missing values and providing confidence intervals. Scaling up the posterior inference for massi…

Missing Values

Optimization Monte Carlo: Efficient and Embarrassingly Parallel Likelihood-Free Inference

2015-06-11 · NeurIPS 2015 12 · Edward Meeds, Max Welling

We describe an embarrassingly parallel, anytime Monte Carlo method for likelihood-free models. The algorithm starts with the view that the stochasticity of the pseudo-samples generated by the simulator can be controlled …

Parallel MCMC Without Embarrassing Failures

2022-02-22 · Daniel Augusto de Souza, Diego Mesquita, Samuel Kaski, Luigi Acerbi

Embarrassingly parallel Markov Chain Monte Carlo (MCMC) exploits parallel computing to scale Bayesian inference to large datasets by using a two-step approach. First, MCMC is run in parallel on (sub)posteriors defined on…

Active LearningBayesian Inference