Localizing and Amortizing: Efficient Inference for Gaussian Processes
The inference of Gaussian Processes concerns the distribution of the underlying function given observed data points. GP inference based on local ranges of data points is able to capture fine-scale correlations and allow fine-grained decomposition of the computation. Following this direction, we propose a new inference model that considers the correlations and observations of the K nearest neighbors for the inference at a data point. Compared with previous works, we also eliminate the data ordering prerequisite to simplify the inference process. Additionally, the inference task is decomposed to small subtasks with several technique innovations, making our model well suits the stochastic optimization. Since the decomposed small subtasks have the same structure, we further speed up the inference procedure with amortized inference. Our model runs efficiently and achieves good performances on several benchmark tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Gaussian ProcessesStochastic OptimizationSimilar Papers 제목 키워드 기반
Amortized Inference for Gaussian Process Hyperparameters of Structured Kernels
Learning the kernel parameters for Gaussian processes is often the computational bottleneck in applications such as online learning, Bayesian optimization, or active learning. Amortizing parameter inference over differen…
Active LearningBayesian OptimizationGaussian ProcessesSimulation-based inference via telescoping ratio estimation for trawl processes
The growing availability of large and complex datasets has increased interest in temporal stochastic processes that can capture stylized facts such as marginal skewness, non-Gaussian tails, long memory, and even non-Mark…
Gaussian ProcessesThree Costs of Amortizing Gaussian Process Inference with Neural Processes
Neural processes amortize Gaussian process inference, replacing the exact $O(n^3)$ posterior with a learned $O(n)$ map from context sets to predictive distributions. For a class of latent neural processes, we bound the K…
On Amortizing Inference Cost for Structured Prediction
Amortized Monte Carlo Integration
Current approaches to amortizing Bayesian inference focus solely on approximating the posterior distribution. Typically, this approximation is, in turn, used to calculate expectations for one or more target functions - a…
Bayesian Inference