paper-with-me

Papers

Latent Gaussian Model Boosting

2021-05-19 · Fabio Sigrist

Latent Gaussian models and boosting are widely used techniques in statistics and machine learning. Tree-boosting shows excellent prediction accuracy on many data sets, but potential drawbacks are that it assumes conditional independence of samples, produces discontinuous predictions for, e.g., spatial data, and it can have difficulty with high-cardinality categorical variables. Latent Gaussian models, such as Gaussian process and grouped random effects models, are flexible prior models which explicitly model dependence among samples and which allow for efficient learning of predictor functions and for making probabilistic predictions. However, existing latent Gaussian models usually assume either a zero or a linear prior mean function which can be an unrealistic assumption. This article introduces a novel approach that combines boosting and latent Gaussian models to remedy the above-mentioned drawbacks and to leverage the advantages of both techniques. We obtain increased prediction accuracy compared to existing approaches in both simulated and real-world data experiments.

📄 PDF Abstract BibTeX arXiv:2105.08966

Code (1)

fabsig/GPBoost 공식 구현

Tasks

model

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Covariance-Boosted Gaussian Processes for Spatiotemporal Irregularities

2026-07-25 · Jeremy Ovadia arxiv

Nonstationary Gaussian process (GP) models are powerful tools for capturing input-dependent variability by adapting to observed data. However, with limited sampling and highly parameterized covariance structure, they are…

Gaussian Processes

Gaussian Process Boosting

2020-04-06 · Fabio Sigrist

We introduce a novel way to combine boosting with Gaussian process and mixed effects models. This allows for relaxing, first, the zero or linearity assumption for the prior mean function in Gaussian process and grouped r…

Gradient Boosting Performs Gaussian Process Inference

2022-06-11 · Aleksei Ustimenko, Artem Beliakov, Liudmila Prokhorenkova

This paper shows that gradient boosting based on symmetric decision trees can be equivalently reformulated as a kernel method that converges to the solution of a certain Kernel Ridge Regression problem. Thus, we obtain t…

regression

Structured Regression Gradient Boosting

2016-06-01 · CVPR 2016 6 · Ferran Diego, Fred A. Hamprecht

We propose a new way to train a structured output prediction model. More specifically, we train nonlinear data terms in a Gaussian Conditional Random Field (GCRF) by a generalized version of gradient boosting. The appro…

Depth EstimationImage InpaintingregressionVessel Detection

A functional central limit theorem for kernel gradient flow and infinitesimal gradient boosting

2026-06-24 · Clément Dombry, Jean-Jil Duchamps arxiv

Building on the large-sample analysis of infinitesimal gradient boosting (Dombry and Duchamps, 2024b), we study the fluctuations of the process around its deterministic limit and establish a functional central limit theo…