Nyström Regularization for Time Series Forecasting

2021-11-13 · Zirui Sun, Mingwei Dai, Yao Wang, Shao-Bo Lin

This paper focuses on learning rate analysis of Nystr\"{o}m regularization with sequential sub-sampling for $\tau$-mixing time series. Using a recently developed Banach-valued Bernstein inequality for $\tau$-mixing sequences and an integral operator approach based on second-order decomposition, we succeed in deriving almost optimal learning rates of Nystr\"{o}m regularization with sequential sub-sampling for $\tau$-mixing time series. A series of numerical experiments are carried out to verify our theoretical results, showing the excellent learning performance of Nystr\"{o}m regularization with sequential sub-sampling in learning massive time series data. All these results extend the applicable range of Nystr\"{o}m regularization from i.i.d. samples to non-i.i.d. sequences.

📄 PDF Abstract BibTeX arXiv:2111.07109

Code (0)

등록된 구현이 없습니다.

Tasks

Time SeriesTime Series Analysis Time Series Forecasting

Deep Learning with Kernel Flow Regularization for Time Series Forecasting

2021-09-23 · Mahdy Shirdel, Reza Asadi, Duc Do, Micheal Hintlian

Long Short-Term Memory (LSTM) neural networks have been widely used for time series forecasting problems. However, LSTMs are prone to overfitting and performance reduction during test phases. Several different regulariza…

Deep Learning Time Series Time Series Analysis Time Series Forecasting

Manifold regularization based on Nystr{ö}m type subsampling

2017-10-13 · Abhishake Rastogi, Sivananthan Sampath

In this paper, we study the Nystr{\"o}m type subsampling for large scale kernel methods to reduce the computational complexities of big data. We discuss the multi-penalty regularization scheme based on Nystr{\"o}m type s…

image-classification Image Classification Intrusion Detection Multi-Task Learning+1

Less is More: Nyström Computational Regularization

2015-07-16 · NeurIPS 2015 12 · Alessandro Rudi, Raffaello Camoriano, Lorenzo Rosasco

We study Nystr\"om type subsampling approaches to large scale kernel methods, and prove learning bounds in the statistical learning setting, where random sampling and high probability estimates are considered. In particu…

Time Series Forecasting Models Copy the Past: How to Mitigate

2022-07-27 · Chrysoula Kosma, Giannis Nikolentzos, Nancy Xu, Michalis Vazirgiannis

Time series forecasting is at the core of important application domains posing significant challenges to machine learning algorithms. Recently neural network architectures have been widely applied to the problem of time …

Time Series Time Series Analysis Time Series Forecasting

Addressing Prediction Delays in Time Series Forecasting: A Continuous GRU Approach with Derivative Regularization

2024-06-29 · Sheo Yon Jhin, Seojin Kim, Noseong Park

Time series forecasting has been an essential field in many different application areas, including economic analysis, meteorology, and so forth. The majority of time series forecasting models are trained using the mean s…

Dynamic Time Warping Prediction Time Series Time Series Forecasting+1