paper-with-me

홈 › Papers

Projecting basis functions with tensor networks for Gaussian process regression

2023-10-31 · Clara Menzen, Eva Memmel, Kim Batselier, Manon Kok

This paper presents a method for approximate Gaussian process (GP) regression with tensor networks (TNs). A parametric approximation of a GP uses a linear combination of basis functions, where the accuracy of the approximation depends on the total number of basis functions $M$. We develop an approach that allows us to use an exponential amount of basis functions without the corresponding exponential computational complexity. The key idea to enable this is using low-rank TNs. We first find a suitable low-dimensional subspace from the data, described by a low-rank TN. In this low-dimensional subspace, we then infer the weights of our model by solving a Bayesian inference problem. Finally, we project the resulting weights back to the original space to make GP predictions. The benefit of our approach comes from the projection to a smaller subspace: It modifies the shape of the basis functions in a way that it sees fit based on the given data, and it allows for efficient computations in the smaller subspace. In an experiment with an 18-dimensional benchmark data set, we show the applicability of our method to an inverse dynamics problem.

📄 PDF Abstract BibTeX arXiv:2310.20630

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian InferenceregressionTensor Networks

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Actually Sparse Variational Gaussian Processes

2023-04-11 · Harry Jake Cunningham, Daniel Augusto de Souza, So Takao, Mark van der Wilk 외

Gaussian processes (GPs) are typically criticised for their unfavourable scaling in both computational and memory requirements. For large datasets, sparse GPs reduce these demands by conditioning on a small set of induci…

Gaussian Processes

Bayesian Additive Adaptive Basis Tensor Product Models for Modeling High Dimensional Surfaces: An application to high-throughput toxicity testing

2017-02-15 · Matthew W. Wheeler

Many modern data sets are sampled with error from complex high-dimensional surfaces. Methods such as tensor product splines or Gaussian processes are effective/well suited for characterizing a surface in two or three dim…

Gaussian ProcessesVocal Bursts Intensity Prediction

Tensor-based Basis Function Learning for Three-dimensional Sound Speed Fields

2022-01-21 · Lei Cheng, Xingyu Ji, Hangfang Zhao, Jianlong Li 외

Basis function learning is the stepping stone towards effective three-dimensional (3D) sound speed field (SSF) inversion for various acoustic signal processing tasks, including ocean acoustic tomography, underwater targe…

Tensor Decomposition

Sparse Gaussian Process Based On Hat Basis Functions

2020-06-15 · Wenqi Fang, Huiyun Li, Hui Huang, Shaobo Dang 외

Gaussian process is one of the most popular non-parametric Bayesian methodologies for modeling the regression problem. It is completely determined by its mean and covariance functions. And its linear property makes it re…

regression

Modeling massive highly-multivariate nonstationary spatial data with the basis graphical lasso

2021-01-07 · Mitchell Krock, William Kleiber, Dorit Hammerling, Stephen Becker

We propose a new modeling framework for highly-multivariate spatial processes that synthesizes ideas from recent multiscale and spectral approaches with graphical models. The basis graphical lasso writes a univariate Gau…