ONE-NAS: An Online NeuroEvolution based Neural Architecture Search for Time Series Forecasting
Time series forecasting (TSF) is one of the most important tasks in data science, as accurate time series (TS) predictions can drive and advance a wide variety of domains including finance, transportation, health care, and power systems. However, real-world utilization of machine learning (ML) models for TSF suffers due to pretrained models being able to learn and adapt to unpredictable patterns as previously unseen data arrives over longer time scales. To address this, models must be periodically retained or redesigned, which takes significant human and computational resources. This work presents the Online NeuroEvolution based Neural Architecture Search (ONE-NAS) algorithm, which to the authors' knowledge is the first neural architecture search algorithm capable of automatically designing and training new recurrent neural networks (RNNs) in an online setting. Without any pretraining, ONE-NAS utilizes populations of RNNs which are continuously updated with new network structures and weights in response to new multivariate input data. ONE-NAS is tested on real-world large-scale multivariate wind turbine data as well a univariate Dow Jones Industrial Average (DJIA) dataset, and is shown to outperform traditional statistical time series forecasting, including naive, moving average, and exponential smoothing methods, as well as state of the art online ARIMA strategies.
Code (0)
등록된 구현이 없습니다.
Tasks
Neural Architecture SearchTime SeriesTime Series AnalysisTime Series ForecastingSimilar Papers 제목 키워드 기반
Provably Sub-Linear Two-Timescale NeuroEvolution with Online Plasticity
NeuroEvolution of Augmenting Topologies (NEAT) is a widely used neuroevolution algorithm for learning neural network architectures and weights for control tasks. However, standard offline optimisation searches for connec…
Reinforcement LearningContinuous ControlOnline Evolutionary Neural Architecture Search for Multivariate Non-Stationary Time Series Forecasting
Time series forecasting (TSF) is one of the most important tasks in data science given the fact that accurate time series (TS) predictive models play a major role across a wide variety of domains including finance, trans…
Neural Architecture SearchTime SeriesTime Series AnalysisTime Series ForecastingAD-NEV: A Scalable Multi-level Neuroevolution Framework for Multivariate Anomaly Detection
Anomaly detection tools and methods present a key capability in modern cyberphysical and failure prediction systems. Despite the fast-paced development in deep learning architectures for anomaly detection, model optimiza…
Anomaly DetectionModel OptimizationTime SeriesTime Series Anomaly DetectionEnsemble neuroevolution based approach for multivariate time series anomaly detection
Multivariate time series anomaly detection is a very common problem in the field of failure prevention. Fast prevention means lower repair costs and losses. The amount of sensors in novel industry systems makes the anoma…
Anomaly DetectionDeep LearningTime SeriesTime Series Analysis+1Seq103: A Unified Neuroevolution Framework for Compact Sequence Architecture Discovery
Neuroevolution is a representative neural architecture search paradigm that evolves both network topology and weights through evolutionary algorithms. In this paper, we propose Seq103, a unified NEAT-style neuroevolution…
Neural Architecture SearchText Classification