An Analysis of Linear Time Series Forecasting Models
Despite their simplicity, linear models perform well at time series forecasting, even when pitted against deeper and more expensive models. A number of variations to the linear model have been proposed, often including some form of feature normalisation that improves model generalisation. In this paper we analyse the sets of functions expressible using these linear model architectures. In so doing we show that several popular variants of linear models for time series forecasting are equivalent and functionally indistinguishable from standard, unconstrained linear regression. We characterise the model classes for each linear variant. We demonstrate that each model can be reinterpreted as unconstrained linear regression over a suitably augmented feature set, and therefore admit closed-form solutions when using a mean-squared loss function. We provide experimental evidence that the models under inspection learn nearly identical solutions, and finally demonstrate that the simpler closed form solutions are superior forecasters across 72% of test settings.
Code (3)
Tasks
FormregressionTime SeriesTime Series ForecastingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A projected nonlinear state-space model for forecasting time series signals
Learning and forecasting stochastic time series is essential in various scientific fields. However, despite the proposals of nonlinear filters and deep-learning methods, it remains challenging to capture nonlinear dynami…
BenchmarkingComputational EfficiencyTime SeriesTime Series AnalysisA Novel Hyperdimensional Computing Framework for Online Time Series Forecasting on the Edge
In recent years, both online and offline deep learning models have been developed for time series forecasting. However, offline deep forecasting models fail to adapt effectively to changes in time-series data, while onli…
Time SeriesTime Series ForecastingAn Attention Free Long Short-Term Memory for Time Series Forecasting
Deep learning is playing an increasingly important role in time series analysis. We focused on time series forecasting using attention free mechanism, a more efficient framework, and proposed a new architecture for time …
PredictionTime SeriesTime Series AnalysisTime Series Forecasting+1Stanza: A Nonlinear State Space Model for Probabilistic Inference in Non-Stationary Time Series
Time series with long-term structure arise in a variety of contexts and capturing this temporal structure is a critical challenge in time series analysis for both inference and forecasting settings. Traditionally, state …
Deep LearningState Space ModelsTime SeriesTime Series AnalysisData Normalization for Bilinear Structures in High-Frequency Financial Time-series
Abstract—Financial time-series analysis and forecasting have been extensively studied over the past decades, yet still remain as a very challenging research topic. Since the financial market is inherently noisy and st…
Time SeriesTime Series AnalysisVocal Bursts Intensity Prediction