paper-with-me

홈 › Papers

Combining Pseudo-Point and State Space Approximations for Sum-Separable Gaussian Processes

2021-06-18 · pproximateinference AABI Symposium 2021 1 · Will Tebbutt, Arno Solin, Richard E. Turner

Gaussian processes (GPs) are important probabilistic tools for inference and learning in spatio-temporal modelling problems such as those in climate science and epidemiology. However, existing GP approximations do not simultaneously support large numbers of off-the-grid spatial data-points and long time-series which is a hallmark of many applications. Pseudo-point approximations, one of the gold-standard methods for scaling GPs to large data sets, are well suited for handling off-the-grid spatial data. However, they cannot handle long temporal observation horizons effectively reverting to cubic computational scaling in the time dimension. State space GP approximations are well suited to handling temporal data, if the temporal GP prior admits a Markov form, leading to linear complexity in the number of temporal observations, but have a cubic spatial cost and cannot handle off-the-grid spatial data. In this work we show that there is a simple and elegant way to combine pseudo-point methods with the state space GP approximation framework to get the best of both worlds. The approach hinges on a surprising conditional independence property which applies to space--time separable GPs. We demonstrate empirically that the combined approach is more scalable and applicable to a greater range of spatio-temporal problems than either method on its own.

📄 PDF Abstract BibTeX arXiv:2106.10210

Code (1)

willtebbutt/PseudoPointStateSpace-UAI-2021 공식 구현

Tasks

EpidemiologyGaussian ProcessesTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

GPS Greedy Policy Search (GPS) is a simple algorithm that learns a policy for test-time data augmentation based on the predictive performance on a validation set. GPS starts with…

Similar Papers 제목 키워드 기반

A Unifying Framework for Gaussian Process Pseudo-Point Approximations using Power Expectation Propagation

2016-05-23 · Thang D. Bui, Josiah Yan, Richard E. Turner

Gaussian processes (GPs) are flexible distributions over functions that enable high-level assumptions about unknown functions to be encoded in a parsimonious, flexible and general way. Although elegant, the application o…

Gaussian Processes

Tree-structured Gaussian Process Approximations

2014-12-01 · NeurIPS 2014 12 · Thang D. Bui, Richard E. Turner

Gaussian process regression can be accelerated by constructing a small pseudo-dataset to summarise the observed data. This idea sits at the heart of many approximation schemes, but such an approach requires the number of…

ImputationregressionTime SeriesTime Series Analysis

A quantum tug of war between randomness and symmetries on homogeneous spaces

2023-09-11 · Rahul Arvind, Kishor Bharti, Jun Yong Khoo, Dax Enshan Koh 외

We explore the interplay between symmetry and randomness in quantum information. Adopting a geometric approach, we consider states as $H$-equivalent if related by a symmetry transformation characterized by the group $H$.…

Quantum Machine Learning

Temporal-Difference estimation of dynamic discrete choice models

2019-12-19 · Karun Adusumilli, Dita Eckardt

We study the use of Temporal-Difference learning for estimating the structural parameters in dynamic discrete choice models. Our algorithms are based on the conditional choice probability approach but use functional appr…

Discrete Choice Models

A Kernel Perspective for Regularizing Deep Neural Networks

2018-09-30 · Alberto Bietti, Grégoire Mialon, Dexiong Chen, Julien Mairal

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations lead…