Bayesian Learning from Sequential Data using Gaussian Processes with Signature Covariances

2019-06-19 · ICML 2020 1 · Csaba Toth, Harald Oberhauser

We develop a Bayesian approach to learning from sequential data by using Gaussian processes (GPs) with so-called signature kernels as covariance functions. This allows to make sequences of different length comparable and to rely on strong theoretical results from stochastic analysis. Signatures capture sequential structure with tensors that can scale unfavourably in sequence length and state space dimension. To deal with this, we introduce a sparse variational approach with inducing tensors. We then combine the resulting GP with LSTMs and GRUs to build larger models that leverage the strengths of each of these approaches and benchmark the resulting GPs on multivariate time series (TS) classification datasets. Code available at https://github.com/tgcsaba/GPSig.

📄 PDF Abstract BibTeX arXiv:1906.08215

Code (1)

tgcsaba/GPSig 공식 구현 tf

Tasks

Gaussian Processes General ClassificationTime SeriesTime Series Analysis Time Series Classification

Methods 이 논문이 사용한 방법론

GRU A Gated Recurrent Unit, or GRU, is a type of recurrent neural network. It is similar to an LSTM, but only has two gates - a reset…

LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Learning to Forget: Bayesian Time Series Forecasting using Recurrent Sparse Spectrum Signature Gaussian Processes

2024-12-27 · Csaba Tóth, Masaki Adachi, Michael A. Osborne, Harald Oberhauser

The signature kernel is a kernel between time series of arbitrary length and comes with strong theoretical guarantees from stochastic analysis. It has found applications in machine learning such as covariance functions f…

Gaussian Processes GPU Probabilistic Time Series Forecasting Time Series+2

Scalable Machine Learning Algorithms using Path Signatures

2025-06-21 · Csaba Tóth

The interface between stochastic analysis and machine learning is a rapidly evolving field, with path signatures - iterated integrals that provide faithful, hierarchical representations of paths - offering a principled a…

Computational Efficiency Gaussian Processes Time Series Time Series Forecasting

SigGPDE: Scaling Sparse Gaussian Processes on Sequential Data

2021-05-10 · Maud Lemercier, Cristopher Salvi, Thomas Cass, Edwin V. Bonilla 외

Making predictions and quantifying their uncertainty when the input data is sequential is a fundamental learning challenge, recently attracting increasing attention. We develop SigGPDE, a new scalable sparse variational …

Gaussian Processes Time Series Time Series Analysis Variational Inference

Gaussian processes based data augmentation and expected signature for time series classification

2023-10-16 · Marco Romito, Francesco Triggiano

The signature is a fundamental object that describes paths (that is, continuous functions from an interval to a Euclidean space). Likewise, the expected signature provides a statistical description of the law of stochast…

Data Augmentation Gaussian Processes Time Series Time Series Classification

Log-Gaussian Gamma Processes for Training Bayesian Neural Networks in Raman and CARS Spectroscopies

2023-10-12 · Teemu Härkönen, Erik M. Vartiainen, Lasse Lensu, Matthew T. Moores 외

We propose an approach utilizing gamma-distributed random variables, coupled with log-Gaussian modeling, to generate synthetic datasets suitable for training neural networks. This addresses the challenge of limited real …

Gaussian Processes parameter estimation Synthetic Data Generation