Evolving Multi-Scale Normalization for Time Series Forecasting under Distribution Shifts
Complex distribution shifts are the main obstacle to achieving accurate long-term time series forecasting. Several efforts have been conducted to capture the distribution characteristics and propose adaptive normalization techniques to alleviate the influence of distribution shifts. However, these methods neglect the intricate distribution dynamics observed from various scales and the evolving functions of distribution dynamics and normalized mapping relationships. To this end, we propose a novel model-agnostic Evolving Multi-Scale Normalization (EvoMSN) framework to tackle the distribution shift problem. Flexible normalization and denormalization are proposed based on the multi-scale statistics prediction module and adaptive ensembling. An evolving optimization strategy is designed to update the forecasting model and statistics prediction module collaboratively to track the shifting distributions. We evaluate the effectiveness of EvoMSN in improving the performance of five mainstream forecasting methods on benchmark datasets and also show its superiority compared to existing advanced normalization and online learning approaches. The code is publicly available at https://github.com/qindalin/EvoMSN.
Code (1)
Tasks
Time SeriesTime Series ForecastingSimilar Papers 제목 키워드 기반
Adaptive Normalization for Non-stationary Time Series Forecasting: A Temporal Slice Perspective
Deep learning models have progressively advanced time series forecasting due to their powerful capacity in capturing sequence dependence. Nevertheless, it is still challenging to make accurate predictions due to the exis…
WormKAN: Are KAN Effective for Identifying and Tracking Concept Drift in Time Series?
Dynamic concepts in time series are crucial for understanding complex systems such as financial markets, healthcare, and online activity logs. These concepts help reveal structures and behaviors in sequential data for be…
Decision MakingDecoderDrift DetectionKolmogorov-Arnold Networks+1Deep Adaptive Input Normalization for Time Series Forecasting
Deep Learning (DL) models can be used to tackle time series analysis tasks with great success. However, the performance of DL models can degenerate rapidly if the data are not appropriately normalized. This issue is even…
Load ForecastingTime SeriesTime Series AnalysisTime Series ForecastingDeCoP: Enhancing Self-Supervised Time Series Representation with Dependency Controlled Pre-training
Modeling dynamic temporal dependencies is a critical challenge in time series pre-training, which evolve due to distribution shifts and multi-scale patterns. This temporal variability severely impairs the generalization …
Representation LearningBilinear Input Normalization for Neural Networks in Financial Forecasting
Data normalization is one of the most important preprocessing steps when building a machine learning model, especially when the model of interest is a deep neural network. This is because deep neural network optimized wi…
Time SeriesTime Series Analysis