paper-with-me

Papers

Residual Deep Gaussian Processes on Manifolds

2024-10-31 · Kacper Wyrwal, Andreas Krause, Viacheslav Borovitskiy

We propose practical deep Gaussian process models on Riemannian manifolds, similar in spirit to residual neural networks. With manifold-to-manifold hidden layers and an arbitrary last layer, they can model manifold- and scalar-valued functions, as well as vector fields. We target data inherently supported on manifolds, which is too complex for shallow Gaussian processes thereon. For example, while the latter perform well on high-altitude wind data, they struggle with the more intricate, nonstationary patterns at low altitudes. Our models significantly improve performance in these settings, enhancing prediction quality and uncertainty calibration, and remain robust to overfitting, reverting to shallow models when additional complexity is unneeded. We further showcase our models on Bayesian optimisation problems on manifolds, using stylised examples motivated by robotics, and obtain substantial improvements in later stages of the optimisation process. Finally, we show our models to have potential for speeding up inference for non-manifold data, when, and if, it can be mapped to a proxy manifold well enough.

📄 PDF Abstract BibTeX arXiv:2411.00161

Code (1)

KacperWyrwal/residual-deep-gps 공식 구현 jax

Tasks

Bayesian OptimisationGaussian Processes

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Vector-valued Gaussian Processes on Riemannian Manifolds via Gauge Independent Projected Kernels

2021-10-27 · NeurIPS 2021 12 · Michael Hutchinson, Alexander Terenin, Viacheslav Borovitskiy, So Takao 외

Gaussian processes are machine learning models capable of learning unknown functions in a way that represents uncertainty, thereby facilitating construction of optimal decision-making systems. Motivated by a desire to de…

BIG-bench Machine LearningDecision MakingGaussian ProcessesVariational Inference

Matérn Gaussian processes on Riemannian manifolds

2020-06-17 · NeurIPS 2020 12 · Viacheslav Borovitskiy, Alexander Terenin, Peter Mostowsky, Marc Peter Deisenroth

Gaussian processes are an effective model class for learning unknown functions, particularly in settings where accurately representing predictive uncertainty is of key importance. Motivated by applications in the physica…

Gaussian Processes

Extrinsic Bayesian Optimizations on Manifolds

2022-12-21 · Yihao Fang, Mu Niu, Pokman Cheung, Lizhen Lin

We propose an extrinsic Bayesian optimization (eBO) framework for general optimization problems on manifolds. Bayesian optimization algorithms build a surrogate of the objective function by employing Gaussian processes a…

Bayesian OptimizationGaussian Processesvalid

Gaussian Processes and Statistical Decision-making in Non-Euclidean Spaces

2022-02-22 · Alexander Terenin

Bayesian learning using Gaussian processes provides a foundational framework for making decisions in a manner that balances what is known with what could be learned by gathering data. In this dissertation, we develop tec…

Decision MakingGaussian Processes

Posterior Contraction Rates for Matérn Gaussian Processes on Riemannian Manifolds

2023-09-19 · NeurIPS 2023 11 · Paul Rosa, Viacheslav Borovitskiy, Alexander Terenin, Judith Rousseau

Gaussian processes are used in many machine learning applications that rely on uncertainty quantification. Recently, computational tools for working with these models in geometric settings, such as when inputs lie on a R…

Gaussian ProcessesUncertainty Quantification