paper-with-me

홈 › Papers

xLSTMTime : Long-term Time Series Forecasting With xLSTM

2024-07-14 · Musleh Alharthi, Ausif Mahmood

In recent years, transformer-based models have gained prominence in multivariate long-term time series forecasting (LTSF), demonstrating significant advancements despite facing challenges such as high computational demands, difficulty in capturing temporal dynamics, and managing long-term dependencies. The emergence of LTSF-Linear, with its straightforward linear architecture, has notably outperformed transformer-based counterparts, prompting a reevaluation of the transformer's utility in time series forecasting. In response, this paper presents an adaptation of a recent architecture termed extended LSTM (xLSTM) for LTSF. xLSTM incorporates exponential gating and a revised memory structure with higher capacity that has good potential for LTSF. Our adopted architecture for LTSF termed as xLSTMTime surpasses current approaches. We compare xLSTMTime's performance against various state-of-the-art models across multiple real-world da-tasets, demonstrating superior forecasting capabilities. Our findings suggest that refined recurrent architectures can offer competitive alternatives to transformer-based models in LTSF tasks, po-tentially redefining the landscape of time series forecasting.

📄 PDF Abstract BibTeX arXiv:2407.10240

Code (1)

muslehal/xLSTMTime 공식 구현 pytorch

Tasks

Time SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

MPPN: Multi-Resolution Periodic Pattern Network For Long-Term Time Series Forecasting

2023-06-12 · Xing Wang, Zhendong Wang, Kexin Yang, Junlan Feng 외

Long-term time series forecasting plays an important role in various real-world scenarios. Recent deep learning methods for long-term series forecasting tend to capture the intricate patterns of time series by decomposit…

Time SeriesTime Series Forecasting

Long-term Forecasting with TiDE: Time-series Dense Encoder

2023-04-17 · Abhimanyu Das, Weihao Kong, Andrew Leach, Shaan Mathur 외

Recent work has shown that simple linear models can outperform several Transformer based approaches in long term time-series forecasting. Motivated by this, we propose a Multi-layer Perceptron (MLP) based encoder-decoder…

Anomaly DetectionDecoderTime SeriesTime Series Forecasting

Not All Frequencies Are Created Equal:Towards a Dynamic Fusion of Frequencies in Time-Series Forecasting

2024-07-17 · Xingyu Zhang, Siyu Zhao, Zeen Song, Huijie Guo 외

Long-term time series forecasting is a long-standing challenge in various applications. A central issue in time series forecasting is that methods should expressively capture long-term dependency. Furthermore, time serie…

AllTime SeriesTime Series Forecasting

TimeBridge: Non-Stationarity Matters for Long-term Time Series Forecasting

2024-10-06 · Peiyuan Liu, Beiliang Wu, Yifan Hu, Naiqi Li 외

Non-stationarity poses significant challenges for multivariate time series forecasting due to the inherent short-term fluctuations and long-term trends that can lead to spurious regressions or obscure essential long-term…

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting

Multi-Scale Dilated Convolution Network for Long-Term Time Series Forecasting

2024-05-09 · Feifei Li, Suhan Guo, Feng Han, Jian Zhao 외

Accurate forecasting of long-term time series has important applications for decision making and planning. However, it remains challenging to capture the long-term dependencies in time series data. To better extract long…

Decision MakingTime SeriesTime Series Forecasting