paper-with-me

Papers

WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecasting

2024-12-22 · Md Mahmuddun Nabi Murad, Mehmet Aktukmak, Yasin Yilmaz

Time series forecasting is crucial for various applications, such as weather forecasting, power load forecasting, and financial analysis. In recent studies, MLP-mixer models for time series forecasting have been shown as a promising alternative to transformer-based models. However, the performance of these models is still yet to reach its potential. In this paper, we propose Wavelet Patch Mixer (WPMixer), a novel MLP-based model, for long-term time series forecasting, which leverages the benefits of patching, multi-resolution wavelet decomposition, and mixing. Our model is based on three key components: (i) multi-resolution wavelet decomposition, (ii) patching and embedding, and (iii) MLP mixing. Multi-resolution wavelet decomposition efficiently extracts information in both the frequency and time domains. Patching allows the model to capture an extended history with a look-back window and enhances capturing local information while MLP mixing incorporates global information. Our model significantly outperforms state-of-the-art MLP-based and transformer-based models for long-term time series forecasting in a computationally efficient way, demonstrating its efficacy and potential for practical applications.

📄 PDF Abstract BibTeX arXiv:2412.17176

Code (1)

Secure-and-Intelligent-Systems-Lab/WPMixer 공식 구현 pytorch

Tasks

Financial AnalysisLoad ForecastingTime SeriesTime Series ForecastingWeather Forecasting

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Average Pooling 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
MLP-Mixer 설명 없음

Similar Papers 제목 키워드 기반

SMILE: A Super-resolution Guided Multi-task Learning Method for Hyperspectral Unmixing

2025-09-14 · Ruiying Li, Bin Pan, Qiaoying Qu, Xia Xu 외 arxiv

The performance of hyperspectral unmixing may be constrained by low spatial resolution, which can be enhanced using super-resolution in a multitask learning way. However, integrating super-resolution and unmixing directl…

Multi-Task Learning

Hyperspectral Unmixing of Agricultural Images taken from UAV Using Adapted U-Net Architecture

2024-09-29 · Vytautas Paura, Virginijus Marcinkevičius

The hyperspectral unmixing method is an algorithm that extracts material (usually called endmember) data from hyperspectral data cube pixels along with their abundances. Due to a lower spatial resolution of hyperspectral…

Hyperspectral Unmixing

Spectral Unmixing of Hyperspectral Images Based on Block Sparse Structure

2022-04-10 · Seyed Hossein Mosavi Azarang, Roozbeh Rajabi, Hadi Zayyani, Amin Zehtabian

Spectral unmixing (SU) of hyperspectral images (HSIs) is one of the important areas in remote sensing (RS) that needs to be carefully addressed in different RS applications. Despite the high spectral resolution of the hy…

Hyperspectral Unmixing

WaveMixSR: A Resource-efficient Neural Network for Image Super-resolution

2023-07-01 · Pranav Jeevan, Akella Srinidhi, Pasunuri Prathiba, Amit Sethi

Image super-resolution research recently been dominated by transformer models which need higher computational resources than CNNs due to the quadratic complexity of self-attention. We propose a new neural network -- Wave…

Efficient Neural NetworkImage Super-ResolutionInductive BiasSuper-Resolution

Multilayer Structured NMF for Spectral Unmixing of Hyperspectral Images

2015-06-04 · Roozbeh Rajabi, Hassan Ghassemian

One of the challenges in hyperspectral data analysis is the presence of mixed pixels. Mixed pixels are the result of low spatial resolution of hyperspectral sensors. Spectral unmixing methods decompose a mixed pixel into…