Hyperparameter Tuning MLPs for Probabilistic Time Series Forecasting
Time series forecasting attempts to predict future events by analyzing past trends and patterns. Although well researched, certain critical aspects pertaining to the use of deep learning in time series forecasting remain ambiguous. Our research primarily focuses on examining the impact of specific hyperparameters related to time series, such as context length and validation strategy, on the performance of the state-of-the-art MLP model in time series forecasting. We have conducted a comprehensive series of experiments involving 4800 configurations per dataset across 20 time series forecasting datasets, and our findings demonstrate the importance of tuning these parameters. Furthermore, in this work, we introduce the largest metadataset for timeseries forecasting to date, named TSBench, comprising 97200 evaluations, which is a twentyfold increase compared to previous works in the field. Finally, we demonstrate the utility of the created metadataset on multi-fidelity hyperparameter optimization tasks.
Code (1)
Tasks
Hyperparameter OptimizationProbabilistic Time Series ForecastingTime SeriesTime Series ForecastingSimilar Papers 제목 키워드 기반
TabPack: Efficient Hyperparameter Ensembles for Tabular Deep Learning
In deep learning for tabular data, efficient ensembles of multilayer perceptrons (MLPs) have recently emerged as effective and practical architectures. Existing methods of this kind use the same hyperparameters for all u…
A Worrying Analysis of Probabilistic Time-series Models for Sales Forecasting
Probabilistic time-series models become popular in the forecasting field as they help to make optimal decisions under uncertainty. Despite the growing interest, a lack of thorough analysis hinders choosing what is worth …
Feature EngineeringTime SeriesTime Series AnalysisFrequency-domain MLPs are More Effective Learners in Time Series Forecasting
Time series forecasting has played the key role in different industrial, including finance, traffic, energy, and healthcare domains. While existing literatures have designed many sophisticated architectures based on RNNs…
Time SeriesTime Series ForecastingScoreGrad: Multivariate Probabilistic Time Series Forecasting with Continuous Energy-based Generative Models
Multivariate time series prediction has attracted a lot of attention because of its wide applications such as intelligence transportation, AIOps. Generative models have achieved impressive results in time series modeling…
Probabilistic Time Series ForecastingTime SeriesTime Series AnalysisTime Series Forecasting+1Gradient Descent: The Ultimate Optimizer
Working with any gradient-based machine learning algorithm involves the tedious task of tuning the optimizer's hyperparameters, such as its step size. Recent work has shown how the step size can itself be optimized along…
BIG-bench Machine LearningHyperparameter Optimization