Distributed Gaussian Processes
To scale Gaussian processes (GPs) to large data sets we introduce the robust Bayesian Committee Machine (rBCM), a practical and scalable product-of-experts model for large-scale distributed GP regression. Unlike state-of-the-art sparse GP approximations, the rBCM is conceptually simple and does not rely on inducing or variational parameters. The key idea is to recursively distribute computations to independent computational units and, subsequently, recombine them to form an overall result. Efficient closed-form inference allows for straightforward parallelisation and distributed computations with a small memory footprint. The rBCM is independent of the computational graph and can be used on heterogeneous computing infrastructures, ranging from laptops to clusters. With sufficient computing resources our distributed GP model can handle arbitrarily large data sets.
Code (0)
등록된 구현이 없습니다.
Tasks
FormGaussian ProcessesregressionSimilar Papers 제목 키워드 기반
Distributed Quantum Gaussian Processes for Multi-Agent Systems
Gaussian Processes (GPs) are a powerful tool for probabilistic modeling, but their performance is often constrained in complex, large-scale real-world domains due to the limited expressivity of classical kernels. Quantum…
Distributed OptimizationGaussian ProcessesDistributed Gaussian Process Based Cooperative Visual Pursuit Control for Drone Networks
In this paper, we propose a control law for camera-equipped drone networks to pursue a target rigid body with unknown motion based on distributed Gaussian process. First, we consider the situation where each drone has it…
Gaussian ProcessesLearning of Gaussian Processes in Distributed and Communication Limited Systems
It is of fundamental importance to find algorithms obtaining optimal performance for learning of statistical models in distributed and communication limited systems. Aiming at characterizing the optimal strategies, we co…
Gaussian ProcessesQuantizationNumerical Gaussian process Kalman filtering
In this manuscript we introduce numerical Gaussian process Kalman filtering (GPKF). Numerical Gaussian processes have recently been developed to simulate spatiotemporal models. The contribution of this paper is to embed …
Gaussian ProcessesRobust, Online, and Adaptive Decentralized Gaussian Processes
Gaussian processes (GPs) offer a flexible, uncertainty-aware framework for modeling complex signals, but scale cubically with data, assume static targets, and are brittle to outliers, limiting their applicability in larg…
Gaussian Processes