paper-with-me

홈 › Papers

Ister: Inverted Seasonal-Trend Decomposition Transformer for Explainable Multivariate Time Series Forecasting

2024-12-25 · Fanpu Cao, Shu Yang, Zhengjian Chen, Ye Liu, Laizhong Cui

In long-term time series forecasting, Transformer-based models have achieved great success, due to its ability to capture long-range dependencies. However, existing models face challenges in identifying critical components for prediction, leading to limited interpretability and suboptimal performance. To address these issues, we propose the Inverted Seasonal-Trend Decomposition Transformer (Ister), a novel Transformer-based model for multivariate time series forecasting. Ister decomposes time series into seasonal and trend components, further modeling multi-periodicity and inter-series dependencies using a Dual Transformer architecture. We introduce a novel Dot-attention mechanism that improves interpretability, computational efficiency, and predictive accuracy. Comprehensive experiments on benchmark datasets demonstrate that Ister outperforms existing state-of-the-art models, achieving up to 10% improvement in MSE. Moreover, Ister enables intuitive visualization of component contributions, shedding lights on model's decision process and enhancing transparency in prediction results.

📄 PDF Abstract BibTeX arXiv:2412.18798

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyMultivariate Time Series ForecastingTime SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

DSAT-HD: Dual-Stream Adaptive Transformer with Hybrid Decomposition for Multivariate Time Series Forecasting

2025-09-29 · Zixu Wang, Hongbin Dong, Xiaoping Zhang arxiv

Time series forecasting is crucial for various applications, such as weather, traffic, electricity, and energy predictions. Currently, common time series forecasting methods are based on Transformers. However, existing a…

Multivariate Time Series Forecasting

A Robust and Efficient Multi-Scale Seasonal-Trend Decomposition

2021-09-18 · Linxiao Yang, Qingsong Wen, Bo Yang, Liang Sun

Many real-world time series exhibit multiple seasonality with different lengths. The removal of seasonal components is crucial in numerous applications of time series, including forecasting and anomaly detection. However…

Anomaly DetectionTime SeriesTime Series Analysis

First De-Trend then Attend: Rethinking Attention for Time-Series Forecasting

2022-12-15 · Xiyuan Zhang, Xiaoyong Jin, Karthick Gopalswamy, Gaurav Gupta 외

Transformer-based models have gained large popularity and demonstrated promising results in long-term time-series forecasting in recent years. In addition to learning attention in time domain, recent works also explore l…

Time SeriesTime Series AnalysisTime Series Forecasting

Transformer-Based Bearing Fault Detection using Temporal Decomposition Attention Mechanism

2024-12-15 · Marzieh Mirzaeibonehkhater, Mohammad Ali Labbaf-Khaniki, Mohammad Manthouri

Bearing fault detection is a critical task in predictive maintenance, where accurate and timely fault identification can prevent costly downtime and equipment damage. Traditional attention mechanisms in Transformer neura…

Fault DetectionTime Series

KEDformer:Knowledge Extraction Seasonal Trend Decomposition for Long-term Sequence Prediction

2024-12-06 · Zhenkai Qin, Baozhong Wei, Caifeng Gao, Jianyuan Ni

Time series forecasting is a critical task in domains such as energy, finance, and meteorology, where accurate long-term predictions are essential. While Transformer-based models have shown promise in capturing temporal …

Time SeriesTime Series Forecasting