paper-with-me

Papers

Recurrent Neural Processes

2019-06-13 · Timon Willi, Jonathan Masci, Jürgen Schmidhuber, Christian Osendorfer

We extend Neural Processes (NPs) to sequential data through Recurrent NPs or RNPs, a family of conditional state space models. RNPs model the state space with Neural Processes. Given time series observed on fast real-world time scales but containing slow long-term variabilities, RNPs may derive appropriate slow latent time scales. They do so in an efficient manner by establishing conditional independence among subsequences of the time series. Our theoretically grounded framework for stochastic processes expands the applicability of NPs while retaining their benefits of flexibility, uncertainty estimation, and favorable runtime with respect to Gaussian Processes (GPs). We demonstrate that state spaces learned by RNPs benefit predictive performance on real-world time-series data and nonlinear system identification, even in the case of limited data availability.

📄 PDF Abstract BibTeX arXiv:1906.05915

Code (2)

KurochkinAlexey/Recurrent-neural-process pytorch
KurochkinAlexey/Recurrent-neural-processes pytorch

Tasks

Gaussian ProcessesState Space ModelsTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

Towards Recurrent Autoregressive Flow Models

2020-06-17 · John Mern, Peter Morales, Mykel J. Kochenderfer

Stochastic processes generated by non-stationary distributions are difficult to represent with conventional models such as Gaussian processes. This work presents Recurrent Autoregressive Flows as a method toward general …

Gaussian Processes

Learning Quantum Processes with Memory -- Quantum Recurrent Neural Networks

2023-01-19 · Dmytro Bondarenko, Robert Salzmann, Viktoria-S. Schmiesing

Recurrent neural networks play an important role in both research and industry. With the advent of quantum machine learning, the quantisation of recurrent neural networks has become recently relevant. We propose fully qu…

Quantum Machine Learning

Recurrent Attentive Neural Process for Sequential Data

2019-10-17 · Shenghao Qin, Jiacheng Zhu, Jimmy Qin, Wenshuo Wang 외

Neural processes (NPs) learn stochastic processes and predict the distribution of target output adaptively conditioned on a context set of observed input-output pairs. Furthermore, Attentive Neural Process (ANP) improved…

Autonomous Driving

Complexity-calibrated Benchmarks for Machine Learning Reveal When Next-Generation Reservoir Computer Predictions Succeed and Mislead

2023-03-25 · Sarah E. Marzen, Paul M. Riechers, James P. Crutchfield

Recurrent neural networks are used to forecast time series in finance, climate, language, and from many other domains. Reservoir computers are a particularly easily trainable form of recurrent neural network. Recently, a…

Time Series

Recurrent Gaussian Processes

2015-11-20 · César Lincoln C. Mattos, Zhenwen Dai, Andreas Damianou, Jeremy Forth 외

We define Recurrent Gaussian Processes (RGP) models, a general family of Bayesian nonparametric models with recurrent GP priors which are able to learn dynamical patterns from sequential data. Similar to Recurrent Neural…

Gaussian Processes