paper-with-me

홈 › Papers

EDformer: Embedded Decomposition Transformer for Interpretable Multivariate Time Series Predictions

2024-12-16 · Sanjay Chakraborty, Ibrahim Delibasoglu, Fredrik Heintz

Time series forecasting is a crucial challenge with significant applications in areas such as weather prediction, stock market analysis, and scientific simulations. This paper introduces an embedded decomposed transformer, 'EDformer', for multivariate time series forecasting tasks. Without altering the fundamental elements, we reuse the Transformer architecture and consider the capable functions of its constituent parts in this work. Edformer first decomposes the input multivariate signal into seasonal and trend components. Next, the prominent multivariate seasonal component is reconstructed across the reverse dimensions, followed by applying the attention mechanism and feed-forward network in the encoder stage. In particular, the feed-forward network is used for each variable frame to learn nonlinear representations, while the attention mechanism uses the time points of individual seasonal series embedded within variate frames to capture multivariate correlations. Therefore, the trend signal is added with projection and performs the final forecasting. The EDformer model obtains state-of-the-art predicting results in terms of accuracy and efficiency on complex real-world time series datasets. This paper also addresses model explainability techniques to provide insights into how the model makes its predictions and why specific features or time steps are important, enhancing the interpretability and trustworthiness of the forecasting results.

📄 PDF Abstract BibTeX arXiv:2412.12227

Code (1)

sanjaylopa22/EDformer-Feature-Importance 공식 구현 pytorch

Tasks

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting

2022-01-30 · Tian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang 외

Although Transformer-based methods have significantly improved state-of-the-art results for long-term series forecasting, they are not only computationally expensive but more importantly, are unable to capture the global…

Time SeriesTime Series Analysis

KEDformer:Knowledge Extraction Seasonal Trend Decomposition for Long-term Sequence Prediction

2024-12-06 · Zhenkai Qin, Baozhong Wei, Caifeng Gao, Jianyuan Ni

Time series forecasting is a critical task in domains such as energy, finance, and meteorology, where accurate long-term predictions are essential. While Transformer-based models have shown promise in capturing temporal …

Time SeriesTime Series Forecasting

SEDformer: Event-Synchronous Spiking Transformers for Irregular Telemetry Time Series Forecasting

2026-02-02 · Ziyu Zhou, Yuchen Fang, Weilin Ruan, Shiyu Wang 외 arxiv

Telemetry streams from large-scale Internet-connected systems (e.g., IoT deployments and online platforms) naturally form an irregular multivariate time series (IMTS) whose accurate forecasting is operationally vital. A …

Time Series Forecasting

Expressing Multivariate Time Series as Graphs with Time Series Attention Transformer

2022-08-19 · William T. Ng, K. Siu, Albert C. Cheung, Michael K. Ng

A reliable and efficient representation of multivariate time series is crucial in various downstream machine learning tasks. In multivariate time series forecasting, each variable depends on its historical values and the…

Multivariate Time Series ForecastingRepresentation LearningTime SeriesTime Series Analysis+1

RoMedFormer: A Rotary-Embedding Transformer Foundation Model for 3D Genito-Pelvic Structure Segmentation in MRI and CT

2025-03-18 · Yuheng Li, Mingzhe Hu, Richard L. J. Qiu, Maria Thor 외

Deep learning-based segmentation of genito-pelvic structures in MRI and CT is crucial for applications such as radiation therapy, surgical planning, and disease diagnosis. However, existing segmentation models often stru…

Image SegmentationMedical Image SegmentationSegmentationSelf-Supervised Learning+1