paper-with-me

Papers

Learning Compositional Sparse Gaussian Processes with a Shrinkage Prior

2020-12-21 · Anh Tong, Toan Tran, Hung Bui, Jaesik Choi

Choosing a proper set of kernel functions is an important problem in learning Gaussian Process (GP) models since each kernel structure has different model complexity and data fitness. Recently, automatic kernel composition methods provide not only accurate prediction but also attractive interpretability through search-based methods. However, existing methods suffer from slow kernel composition learning. To tackle large-scaled data, we propose a new sparse approximate posterior for GPs, MultiSVGP, constructed from groups of inducing points associated with individual additive kernels in compositional kernels. We demonstrate that this approximation provides a better fit to learn compositional kernels given empirical observations. We also provide theoretically justification on error bound when compared to the traditional sparse GP. In contrast to the search-based approach, we present a novel probabilistic algorithm to learn a kernel composition by handling the sparsity in the kernel selection with Horseshoe prior. We demonstrate that our model can capture characteristics of time series with significant reductions in computational time and have competitive regression performance on real-world data sets.

📄 PDF Abstract BibTeX arXiv:2012.11339

Code (0)

등록된 구현이 없습니다.

Tasks

Gaussian ProcessesTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…
Interpretability 설명 없음

Similar Papers 제목 키워드 기반

Heavy-Tailed Process Priors for Selective Shrinkage

2010-12-01 · NeurIPS 2010 12 · Fabian L. Wauthier, Michael. I. Jordan

Heavy-tailed distributions are often used to enhance the robustness of regression and classification methods to outliers in output space. Often, however, we are confronted with ``outliers'' in input space, which are iso…

Gaussian ProcessesGeneral Classificationregression

Hierarchical shrinkage Gaussian processes: applications to computer code emulation and dynamical system recovery

2023-02-01 · Tao Tang, Simon Mak, David Dunson

In many areas of science and engineering, computer simulations are widely used as proxies for physical experiments, which can be infeasible or unethical. Such simulations can often be computationally expensive, and an em…

Gaussian ProcessesUncertainty Quantification

Tail-adaptive Bayesian shrinkage

2020-07-04 · Se Yoon Lee, Peng Zhao, Debdeep Pati, Bani K. Mallick

Robust Bayesian methods for high-dimensional regression problems under diverse sparse regimes are studied. Traditional shrinkage priors are primarily designed to detect a handful of signals from tens of thousands of pred…

Variance or Standard Deviation? Shell Geometry and Global-Scale Priors in High-Dimensional Shrinkage

2026-06-22 · Wayne Yuan Gao, Zhiheng You arxiv

We study how the choice of default prior for a common Gaussian scale affects high-dimensional shrinkage risk, highlighting the role played by high-dimensional geometry. Formally, we consider a high-dimensional setting in…

Generalized Cumulative Shrinkage Process Priors with Applications to Sparse Bayesian Factor Analysis

2023-03-01 · Sylvia Frühwirth-Schnatter

The paper discusses shrinkage priors which impose increasing shrinkage in a sequence of parameters. We review the cumulative shrinkage process (CUSP) prior of Legramanti et al. (2020), which is a spike-and-slab shrinkage…