xPatch: Dual-Stream Time Series Forecasting with Exponential Seasonal-Trend Decomposition

2024-12-23 · Artyom Stitsyuk, Jaesik Choi

In recent years, the application of transformer-based models in time-series forecasting has received significant attention. While often demonstrating promising results, the transformer architecture encounters challenges in fully exploiting the temporal relations within time series data due to its attention mechanism. In this work, we design eXponential Patch (xPatch for short), a novel dual-stream architecture that utilizes exponential decomposition. Inspired by the classical exponential smoothing approaches, xPatch introduces the innovative seasonal-trend exponential decomposition module. Additionally, we propose a dual-flow architecture that consists of an MLP-based linear stream and a CNN-based non-linear stream. This model investigates the benefits of employing patching and channel-independence techniques within a non-transformer model. Finally, we develop a robust arctangent loss function and a sigmoid learning rate adjustment scheme, which prevent overfitting and boost forecasting performance. The code is available at the following repository: https://github.com/stitsyuk/xPatch.

📄 PDF Abstract BibTeX arXiv:2412.17323

Code (1)

stitsyuk/xpatch 공식 구현 pytorch

Tasks

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

Patching Activation patching studies the model's computation by altering its latent representations, the token embeddings in transformer-based language models, during the inference process

DualSG: A Dual-Stream Explicit Semantic-Guided Multivariate Time Series Forecasting Framework

2025-07-29 · Kuiye Ding, Fanda Fan, Yao Wang, Ruijie jian 외 arxiv

Multivariate Time Series Forecasting plays a key role in many applications. Recent works have explored using Large Language Models for MTSF to take advantage of their reasoning abilities. However, many methods treat LLMs…

Multivariate Time Series Forecasting

DSPR: Dual-Stream Physics-Residual Networks for Trustworthy Industrial Time Series Forecasting

2026-04-08 · Yeran Zhang, Pengwei Yang, Guoqing Wang, Tianyu Li arxiv

Accurate forecasting of industrial time series requires balancing predictive accuracy with physical plausibility under non-stationary operating conditions. Existing data-driven models often achieve strong statistical per…

Time Series Forecasting

From Similarity to Superiority: Channel Clustering for Time Series Forecasting

2024-03-31 · Jialin Chen, Jan Eric Lenssen, Aosong Feng, Weihua Hu 외

Time series forecasting has attracted significant attention in recent decades. Previous studies have demonstrated that the Channel-Independent (CI) strategy improves forecasting performance by treating different channels…

Clustering Time Series Time Series Forecasting

Ensembles of Randomized NNs for Pattern-based Time Series Forecasting

2021-07-08 · Grzegorz Dudek, Paweł Pełka

In this work, we propose an ensemble forecasting approach based on randomized neural networks. Improved randomized learning streamlines the fitting abilities of individual learners by generating network parameters in acc…

Diversity Time Series Time Series Analysis Time Series Forecasting

DSAT-HD: Dual-Stream Adaptive Transformer with Hybrid Decomposition for Multivariate Time Series Forecasting

2025-09-29 · Zixu Wang, Hongbin Dong, Xiaoping Zhang arxiv

Time series forecasting is crucial for various applications, such as weather, traffic, electricity, and energy predictions. Currently, common time series forecasting methods are based on Transformers. However, existing a…