paper-with-me

홈 › Papers

Gaussian Process-based learning with new MCMC-based implementation of Wishart prior on correlation matrix

2026-05-26 · Kane Warrior, Dalia Chakrabarty arxiv

In probabilstic supervised learning of an input-output relationship - as a sample function of a Gaussian Process (GP) - priors are typically specified for the hyperparameters of the kernel that parametrises the covariance function of the GP, where the induced covariance matrix of the (resulting multivariate Normal) likelihood, governs the learning and prediction. When the sought function is highly multivariate, multiple lengthscale parameters must be learnt simultaneously, making inference difficult. We develop a ``self-assembled'' Wishart prior for the covariance matrix, while undertaking Bayesian inference on the kernel hyperparameters using MCMC. The construction uses a look-back window over recent MCMC iterations to define a time-step dependent scale matrix, thereby introducing adaptiveness to the chain. Results suggest that direct prior specification on the covariance matrix can be useful for diagnosing weakly informative inputs within the GP-based learning paradigm. We support our prior development with two distinct empirical illustrations - one on synthetic data, and another on a real-world dataset.

📄 PDF Abstract BibTeX arXiv:2605.27093

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inference

Similar Papers 제목 키워드 기반

How to use KL-divergence to construct conjugate priors, with well-defined non-informative limits, for the multivariate Gaussian

2021-09-15 · Niko Brümmer

The Wishart distribution is the standard conjugate prior for the precision of the multivariate Gaussian likelihood, when the mean is known -- while the normal-Wishart can be used when the mean is also unknown. It is howe…

Student-t Processes as Alternatives to Gaussian Processes

2014-02-18 · Amar Shah, Andrew Gordon Wilson, Zoubin Ghahramani

We investigate the Student-t process as an alternative to the Gaussian process as a nonparametric prior over functions. We derive closed form expressions for the marginal likelihood and predictive distribution of a Stude…

Bayesian OptimizationGaussian ProcessesModel Selection

An Improved Variational Approximate Posterior for the Deep Wishart Process

2023-05-23 · Sebastian Ober, Ben Anson, Edward Milsom, Laurence Aitchison

Deep kernel processes are a recently introduced class of deep Bayesian models that have the flexibility of neural networks, but work entirely with Gram matrices. They operate by alternately sampling a Gram matrix from a …

Parameter Priors for Directed Acyclic Graphical Models and the Characterization of Several Probability Distributions

2013-01-23 · Dan Geiger, David Heckerman

We show that the only parameter prior for complete Gaussian DAG models that satisfies global parameter independence, complete model equivalence, and some weak regularity assumptions, is the normal-Wishart distribution. O…

Parameter Priors for Directed Acyclic Graphical Models and the Characterization of Several Probability Distributions

2021-05-05 · Dan Geiger, David Heckerman

We develop simple methods for constructing parameter priors for model choice among Directed Acyclic Graphical (DAG) models. In particular, we introduce several assumptions that permit the construction of parameter priors…