Online Data Augmentation for Forecasting with Deep Learning
Deep learning approaches are increasingly used to tackle forecasting tasks involving datasets with multiple univariate time series. A key factor in the successful application of these methods is a large enough training sample size, which is not always available. Synthetic data generation techniques can be applied in these scenarios to augment the dataset. Data augmentation is typically applied offline before training a model. However, when training with mini-batches, some batches may contain a disproportionate number of synthetic samples that do not align well with the original data characteristics. This work introduces an online data augmentation framework that generates synthetic samples during the training of neural networks. By creating synthetic samples for each batch alongside their original counterparts, we maintain a balanced representation between real and synthetic data throughout the training process. This approach fits naturally with the iterative nature of neural network training and eliminates the need to store large augmented datasets. We validated the proposed framework using 3797 time series from 6 benchmark datasets, three neural architectures, and seven synthetic data generation techniques. The experiments suggest that online data augmentation leads to better forecasting performance compared to offline data augmentation or no augmentation approaches. The framework and experiments are publicly available.
Code (1)
Tasks
Data AugmentationDeep LearningSynthetic Data GenerationTime SeriesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A data augmentation strategy for deep neural networks with application to epidemic modelling
In this work, we integrate the predictive capabilities of compartmental disease dynamics models with machine learning ability to analyze complex, high-dimensional data and uncover patterns that conventional models may ov…
Data AugmentationAddressing Concept Shift in Online Time Series Forecasting: Detect-then-Adapt
Online updating of time series forecasting models aims to tackle the challenge of concept drifting by adjusting forecasting models based on streaming data. While numerous algorithms have been developed, most of them focu…
Data AugmentationTime SeriesTime Series ForecastingIBMA: An Imputation-Based Mixup Augmentation Using Self-Supervised Learning for Time Series Data
Data augmentation in time series forecasting plays a crucial role in enhancing model performance by introducing variability while maintaining the underlying temporal patterns. However, time series data offers fewer augme…
Self-Supervised LearningTime Series ForecastingData AugmentationWave-Mask/Mix: Exploring Wavelet-Based Augmentations for Time Series Forecasting
Data augmentation is important for improving machine learning model performance when faced with limited real-world data. In time series forecasting (TSF), where accurate predictions are crucial in fields like finance, he…
Data AugmentationTime SeriesTime Series ForecastingAutomated Data Augmentation for Few-Shot Time Series Forecasting: A Reinforcement Learning Approach Guided by a Model Zoo
Time series forecasting, particularly in few-shot learning scenarios, is challenging due to the limited availability of high-quality training data. To address this, we present a pilot study on using reinforcement learnin…
Data AugmentationDiversityFew-Shot LearningReinforcement Learning (RL)+2