U-Mixer: An Unet-Mixer Architecture with Stationarity Correction for Time Series Forecasting
Time series forecasting is a crucial task in various domains. Caused by factors such as trends, seasonality, or irregular fluctuations, time series often exhibits non-stationary. It obstructs stable feature propagation through deep layers, disrupts feature distributions, and complicates learning data distribution changes. As a result, many existing models struggle to capture the underlying patterns, leading to degraded forecasting performance. In this study, we tackle the challenge of non-stationarity in time series forecasting with our proposed framework called U-Mixer. By combining Unet and Mixer, U-Mixer effectively captures local temporal dependencies between different patches and channels separately to avoid the influence of distribution variations among channels, and merge low- and high-levels features to obtain comprehensive data representations. The key contribution is a novel stationarity correction method, explicitly restoring data distribution by constraining the difference in stationarity between the data before and after model processing to restore the non-stationarity information, while ensuring the temporal dependencies are preserved. Through extensive experiments on various real-world time series datasets, U-Mixer demonstrates its effectiveness and robustness, and achieves 14.5\% and 7.7\% improvements over state-of-the-art (SOTA) methods.
Code (1)
Tasks
Time SeriesTime Series ForecastingSimilar Papers 제목 키워드 기반
DPWMixer: Dual-Path Wavelet Mixer for Long-Term Time Series Forecasting
Long-term time series forecasting (LTSF) is a critical task in computational intelligence. While Transformer-based models effectively capture long-range dependencies, they often suffer from quadratic complexity and overf…
Time Series ForecastingBoosting Adversarial Transferability of MLP-Mixer
The security of models based on new architectures such as MLP-Mixer and ViTs needs to be studied urgently. However, most of the current researches are mainly aimed at the adversarial attack against ViTs, and there is sti…
Adversarial AttackMixerFlow: MLP-Mixer meets Normalising Flows
Normalising flows are generative models that transform a complex density into a simpler density through the use of bijective transformations enabling both density estimation and data generation from a single model. %Howe…
Density EstimationKolmogorov-Arnold NetworksNormalising FlowsiMixer: hierarchical Hopfield network implies an invertible, implicit and iterative MLP-Mixer
In the last few years, the success of Transformers in computer vision has stimulated the discovery of many alternative models that compete with Transformers, such as the MLP-Mixer. Despite their weak inductive bias, thes…
image-classificationImage ClassificationInductive BiasKAN-Mixers: a new deep learning architecture for image classification
Due to their effective performance, Convolutional Neural Network (CNN) and Vision Transformer (ViT) architectures have become the standard for solving computer vision tasks. Such architectures require large data sets and…
Deep Learningimage-classificationImage Classification