Simple Feedfoward Neural Networks are Almost All You Need for Time Series Forecasting
Time series data are everywhere -- from finance to healthcare -- and each domain brings its own unique complexities and structures. While advanced models like Transformers and graph neural networks (GNNs) have gained popularity in time series forecasting, largely due to their success in tasks like language modeling, their added complexity is not always necessary. In our work, we show that simple feedforward neural networks (SFNNs) can achieve performance on par with, or even exceeding, these state-of-the-art models, while being simpler, smaller, faster, and more robust. Our analysis indicates that, in many cases, univariate SFNNs are sufficient, implying that modeling interactions between multiple series may offer only marginal benefits. Even when inter-series relationships are strong, a basic multivariate SFNN still delivers competitive results. We also examine some key design choices and offer guidelines on making informed decisions. Additionally, we critique existing benchmarking practices and propose an improved evaluation protocol. Although SFNNs may not be optimal for every situation (hence the ``almost'' in our title) they serve as a strong baseline that future time series forecasting methods should always be compared against.
Code (0)
등록된 구현이 없습니다.
Tasks
AllBenchmarkingLanguage ModelingLanguage ModellingTime SeriesTime Series ForecastingSimilar Papers 제목 키워드 기반
AALF: Almost Always Linear Forecasting
Recent works for time-series forecasting more and more leverage the high predictive power of Deep Learning models. With this increase in model complexity, however, comes a lack in understanding of the underlying model de…
Decision MakingDeep LearningMeta-LearningModel Selection+2Multi-Agent Feedback Enabled Neural Networks for Intelligent Communications
In the intelligent communication field, deep learning (DL) has attracted much attention due to its strong fitting ability and data-driven learning capability. Compared with the typical DL feedforward network structures, …
DenoisingIntelligent CommunicationOptimal Warping Paths are unique for almost every Pair of Time Series
Update rules for learning in dynamic time warping spaces are based on optimal warping paths between parameter and input time series. In general, optimal warping paths are not unique resulting in adverse effects in theory…
Dynamic Time WarpingTime SeriesTime Series AnalysisClustering Time-Series by a Novel Slope-Based Similarity Measure Considering Particle Swarm Optimization
Recently there has been an increase in the studies on time-series data mining specifically time-series clustering due to the vast existence of time-series in various domains. The large volume of data in the form of time-…
ClusteringDynamic Time WarpingTime SeriesTime Series Analysis+1Fast and Accurate Time Series Classification with WEASEL
Time series (TS) occur in many scientific and commercial applications, ranging from earth surveillance to industry automation to the smart grids. An important type of TS analysis is classification, which can, for instanc…
ClassificationGeneral ClassificationLoad ForecastingTime Series+2