WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecasting
Time series forecasting is crucial for various applications, such as weather forecasting, power load forecasting, and financial analysis. In recent studies, MLP-mixer models for time series forecasting have been shown as a promising alternative to transformer-based models. However, the performance of these models is still yet to reach its potential. In this paper, we propose Wavelet Patch Mixer (WPMixer), a novel MLP-based model, for long-term time series forecasting, which leverages the benefits of patching, multi-resolution wavelet decomposition, and mixing. Our model is based on three key components: (i) multi-resolution wavelet decomposition, (ii) patching and embedding, and (iii) MLP mixing. Multi-resolution wavelet decomposition efficiently extracts information in both the frequency and time domains. Patching allows the model to capture an extended history with a look-back window and enhances capturing local information while MLP mixing incorporates global information. Our model significantly outperforms state-of-the-art MLP-based and transformer-based models for long-term time series forecasting in a computationally efficient way, demonstrating its efficacy and potential for practical applications.
Code (1)
Tasks
Financial AnalysisLoad ForecastingTime SeriesTime Series ForecastingWeather ForecastingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SMILE: A Super-resolution Guided Multi-task Learning Method for Hyperspectral Unmixing
The performance of hyperspectral unmixing may be constrained by low spatial resolution, which can be enhanced using super-resolution in a multitask learning way. However, integrating super-resolution and unmixing directl…
Multi-Task LearningHyperspectral Unmixing of Agricultural Images taken from UAV Using Adapted U-Net Architecture
The hyperspectral unmixing method is an algorithm that extracts material (usually called endmember) data from hyperspectral data cube pixels along with their abundances. Due to a lower spatial resolution of hyperspectral…
Hyperspectral UnmixingSpectral Unmixing of Hyperspectral Images Based on Block Sparse Structure
Spectral unmixing (SU) of hyperspectral images (HSIs) is one of the important areas in remote sensing (RS) that needs to be carefully addressed in different RS applications. Despite the high spectral resolution of the hy…
Hyperspectral UnmixingWaveMixSR: A Resource-efficient Neural Network for Image Super-resolution
Image super-resolution research recently been dominated by transformer models which need higher computational resources than CNNs due to the quadratic complexity of self-attention. We propose a new neural network -- Wave…
Efficient Neural NetworkImage Super-ResolutionInductive BiasSuper-ResolutionMultilayer Structured NMF for Spectral Unmixing of Hyperspectral Images
One of the challenges in hyperspectral data analysis is the presence of mixed pixels. Mixed pixels are the result of low spatial resolution of hyperspectral sensors. Spectral unmixing methods decompose a mixed pixel into…