paper-with-me

Papers

Posterior Contraction Rates for Matérn Gaussian Processes on Riemannian Manifolds

2023-09-19 · NeurIPS 2023 11 · Paul Rosa, Viacheslav Borovitskiy, Alexander Terenin, Judith Rousseau

Gaussian processes are used in many machine learning applications that rely on uncertainty quantification. Recently, computational tools for working with these models in geometric settings, such as when inputs lie on a Riemannian manifold, have been developed. This raises the question: can these intrinsic models be shown theoretically to lead to better performance, compared to simply embedding all relevant quantities into $\mathbb{R}^d$ and using the restriction of an ordinary Euclidean Gaussian process? To study this, we prove optimal contraction rates for intrinsic Mat\'ern Gaussian processes defined on compact Riemannian manifolds. We also prove analogous rates for extrinsic processes using trace and extension theorems between manifold and ambient Sobolev spaces: somewhat surprisingly, the rates obtained turn out to coincide with those of the intrinsic processes, provided that their smoothness parameters are matched appropriately. We illustrate these rates empirically on a number of examples, which, mirroring prior work, show that intrinsic processes can achieve better performance in practice. Therefore, our work shows that finer-grained analyses are needed to distinguish between different levels of data-efficiency of geometric Gaussian processes, particularly in settings which involve small data set sizes and non-asymptotic behavior.

📄 PDF Abstract BibTeX arXiv:2309.10918

Code (1)

aterenin/geometric_asymptotics 공식 구현 jax

Tasks

Gaussian ProcessesUncertainty Quantification

Similar Papers 제목 키워드 기반

Equivalence of Convergence Rates of Posterior Distributions and Bayes Estimators for Functions and Nonparametric Functionals

2020-11-27 · Zejian Liu, Meng Li

We study the posterior contraction rates of a Bayesian method with Gaussian process priors in nonparametric regression and its plug-in property for differential operators. For a general class of kernels, we establish con…

Gaussian Processesregression

Gaussian Processes and Statistical Decision-making in Non-Euclidean Spaces

2022-02-22 · Alexander Terenin

Bayesian learning using Gaussian processes provides a foundational framework for making decisions in a manner that balances what is known with what could be learned by gathering data. In this dissertation, we develop tec…

Decision MakingGaussian Processes

Riemannian Laplace approximations for Bayesian neural networks

2023-06-12 · NeurIPS 2023 11

Bayesian neural networks often approximate the weight-posterior with a Gaussian distribution. However, practical posteriors are often, even locally, highly non-Gaussian, and empirical performance deteriorates. We propose…

Spectral Bayesian Regression on the Sphere

2026-01-28 · Claudio Durastanti arxiv

We develop a fully intrinsic Bayesian framework for nonparametric regression on the unit sphere based on isotropic Gaussian field priors and the harmonic structure induced by the Laplace-Beltrami operator. Under uniform …

SPDE Methods for Nonparametric Bayesian Posterior Contraction and Laplace Approximation

2026-03-23 · Enric Alberola-Boloix, Ioar Casado-Telletxea arxiv

We derive posterior contraction rates (PCRs) and finite-sample Bernstein von Mises (BvM) results for non-parametric Bayesian models by extending the diffusion-based framework of Mou et al. (2024) to the infinite-dimensio…