paper-with-me

홈 › Papers

Evolving Multi-Scale Normalization for Time Series Forecasting under Distribution Shifts

2024-09-29 · Dalin Qin, Yehui Li, Weiqi Chen, Zhaoyang Zhu, Qingsong Wen, Liang Sun, Pierre Pinson, Yi Wang

Complex distribution shifts are the main obstacle to achieving accurate long-term time series forecasting. Several efforts have been conducted to capture the distribution characteristics and propose adaptive normalization techniques to alleviate the influence of distribution shifts. However, these methods neglect the intricate distribution dynamics observed from various scales and the evolving functions of distribution dynamics and normalized mapping relationships. To this end, we propose a novel model-agnostic Evolving Multi-Scale Normalization (EvoMSN) framework to tackle the distribution shift problem. Flexible normalization and denormalization are proposed based on the multi-scale statistics prediction module and adaptive ensembling. An evolving optimization strategy is designed to update the forecasting model and statistics prediction module collaboratively to track the shifting distributions. We evaluate the effectiveness of EvoMSN in improving the performance of five mainstream forecasting methods on benchmark datasets and also show its superiority compared to existing advanced normalization and online learning approaches. The code is publicly available at https://github.com/qindalin/EvoMSN.

📄 PDF Abstract BibTeX arXiv:2409.19718

Code (1)

qindalin/evomsn 공식 구현 pytorch

Tasks

Time SeriesTime Series Forecasting

Similar Papers 제목 키워드 기반

Adaptive Normalization for Non-stationary Time Series Forecasting: A Temporal Slice Perspective

2023-09-21 · NeurIPS 2023 11

Deep learning models have progressively advanced time series forecasting due to their powerful capacity in capturing sequence dependence. Nevertheless, it is still challenging to make accurate predictions due to the exis…

WormKAN: Are KAN Effective for Identifying and Tracking Concept Drift in Time Series?

2024-10-13 · Kunpeng Xu, Lifei Chen, Shengrui Wang

Dynamic concepts in time series are crucial for understanding complex systems such as financial markets, healthcare, and online activity logs. These concepts help reveal structures and behaviors in sequential data for be…

Decision MakingDecoderDrift DetectionKolmogorov-Arnold Networks+1

Deep Adaptive Input Normalization for Time Series Forecasting

2019-02-21 · Nikolaos Passalis, Anastasios Tefas, Juho Kanniainen, Moncef Gabbouj 외

Deep Learning (DL) models can be used to tackle time series analysis tasks with great success. However, the performance of DL models can degenerate rapidly if the data are not appropriately normalized. This issue is even…

Load ForecastingTime SeriesTime Series AnalysisTime Series Forecasting

DeCoP: Enhancing Self-Supervised Time Series Representation with Dependency Controlled Pre-training

2025-09-18 · Yuemin Wu, Zhongze Wu, Xiu Su, Feng Yang 외 arxiv

Modeling dynamic temporal dependencies is a critical challenge in time series pre-training, which evolve due to distribution shifts and multi-scale patterns. This temporal variability severely impairs the generalization …

Representation Learning

Bilinear Input Normalization for Neural Networks in Financial Forecasting

2021-09-01 · Dat Thanh Tran, Juho Kanniainen, Moncef Gabbouj, Alexandros Iosifidis

Data normalization is one of the most important preprocessing steps when building a machine learning model, especially when the model of interest is a deep neural network. This is because deep neural network optimized wi…

Time SeriesTime Series Analysis