Locally Smoothed Gaussian Process Regression

2022-10-18 · Davit Gogolashvili, Bogdan Kozyrskiy, Maurizio Filippone

We develop a novel framework to accelerate Gaussian process regression (GPR). In particular, we consider localization kernels at each data point to down-weigh the contributions from other data points that are far away, and we derive the GPR model stemming from the application of such localization operation. Through a set of experiments, we demonstrate the competitive performance of the proposed approach compared to full GPR, other localized models, and deep Gaussian processes. Crucially, these performances are obtained with considerable speedups compared to standard global GPR due to the sparsification effect of the Gram matrix induced by the localization operation.

📄 PDF Abstract BibTeX arXiv:2210.09998

Code (0)

등록된 구현이 없습니다.

Tasks

Gaussian ProcessesGPRregression

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Locally Smoothed Neural Networks

2017-11-22 · Liang Pang, Yanyan Lan, Jun Xu, Jiafeng Guo 외

Convolutional Neural Networks (CNN) and the locally connected layer are limited in capturing the importance and relations of different local receptive fields, which are often crucial for tasks such as face verification, …

Face Verification Question Answering Visual Question Answering Visual Question Answering (VQA)

Local Gaussian Regression

2014-02-04 · Franziska Meier, Philipp Hennig, Stefan Schaal

Locally weighted regression was created as a nonparametric learning method that is computationally efficient, can learn from very large amounts of data and add data incrementally. An interesting feature of locally weight…

regression

Statistical Query Lower Bounds for Smoothed Agnostic Learning

2026-02-24 · Ilias Diakonikolas, Daniel M. Kane arxiv

We study the complexity of smoothed agnostic learning, recently introduced by~\cite{CKKMS24}, in which the learner competes with the best classifier in a target class under slight Gaussian perturbations of the inputs. Sp…

Smoothed Gaussian Mixture Models for Video Classification and Recommendation

2020-12-17 · Sirjan Kafle, Aman Gupta, Xue Xia, Ananth Sankar 외

Cluster-and-aggregate techniques such as Vector of Locally Aggregated Descriptors (VLAD), and their end-to-end discriminatively trained equivalents like NetVLAD have recently been popular for video classification and act…

Action Recognition Classification General Classification Video Classification

Incremental Local Gaussian Regression

2014-12-01 · NeurIPS 2014 12 · Franziska Meier, Philipp Hennig, Stefan Schaal

Locally weighted regression (LWR) was created as a nonparametric method that can approximate a wide range of functions, is computationally efficient, and can learn continually from very large amounts of incrementally col…