Data Augmentation Policy Search for Long-Term Forecasting
Data augmentation serves as a popular regularization technique to combat overfitting challenges in neural networks. While automatic augmentation has demonstrated success in image classification tasks, its application to time-series problems, particularly in long-term forecasting, has received comparatively less attention. To address this gap, we introduce a time-series automatic augmentation approach named TSAA, which is both efficient and easy to implement. The solution involves tackling the associated bilevel optimization problem through a two-step process: initially training a non-augmented model for a limited number of epochs, followed by an iterative split procedure. During this iterative process, we alternate between identifying a robust augmentation policy through Bayesian optimization and refining the model while discarding suboptimal runs. Extensive evaluations on challenging univariate and multivariate forecasting benchmark problems demonstrate that TSAA consistently outperforms several robust baselines, suggesting its potential integration into prediction pipelines.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimizationBilevel OptimizationData Augmentationimage-classificationImage ClassificationTime SeriesSimilar Papers 제목 키워드 기반
NOSE Augment: Fast and Effective Data Augmentation Without Searching
Data augmentation has been widely used for enhancing the diversity of training data and model generalization. Different from traditional handcrafted methods, recent research introduced automated search for optimal data a…
Data AugmentationDiversityFace Recognitionimage-classification+3Deep AutoAugment
While recent automated data augmentation methods lead to state-of-the-art results, their design spaces and the derived data augmentation strategies still incorporate strong human priors. In this work, instead of fixing a…
AutoMLData AugmentationImage ClassificationOnline Hyper-parameter Learning for Auto-Augmentation Strategy
Data augmentation is critical to the success of modern deep learning techniques. In this paper, we propose Online Hyper-parameter Learning for Auto-Augmentation (OHL-Auto-Aug), an economical solution that learns the augm…
Data AugmentationDirect Differentiable Augmentation Search
Data augmentation has been an indispensable tool to improve the performance of deep neural networks, however the augmentation can hardly transfer among different tasks and datasets. Consequently, a recent trend is to ado…
AutoMLData AugmentationGPUimage-classification+4Faster and Smarter AutoAugment: Augmentation Policy Search Based on Dynamic Data-Clustering
Data augmentation tuned to datasets and tasks has had great success in various AI applications, such as computer vision, natural language processing, autonomous driving, and bioinformatics. However, most of the specific …
Autonomous DrivingClusteringData AugmentationDiversity+1