paper-with-me

Papers

CAIFormer: A Causal Informed Transformer for Multivariate Time Series Forecasting

2025-05-22 · Xingyu Zhang, Wenwen Qiang, Siyu Zhao, Huijie Guo, Jiangmeng Li, Chuxiong Sun, Changwen Zheng

Most existing multivariate time series forecasting methods adopt an all-to-all paradigm that feeds all variable histories into a unified model to predict their future values without distinguishing their individual roles. However, this undifferentiated paradigm makes it difficult to identify variable-specific causal influences and often entangles causally relevant information with spurious correlations. To address this limitation, we propose an all-to-one forecasting paradigm that predicts each target variable separately. Specifically, we first construct a Structural Causal Model from observational data and then, for each target variable, we partition the historical sequence into four sub-segments according to the inferred causal structure: endogenous, direct causal, collider causal, and spurious correlation. The prediction relies solely on the first three causally relevant sub-segments, while the spurious correlation sub-segment is excluded. Furthermore, we propose Causal Informed Transformer (CAIFormer), a novel forecasting model comprising three components: Endogenous Sub-segment Prediction Block, Direct Causal Sub-segment Prediction Block, and Collider Causal Sub-segment Prediction Block, which process the endogenous, direct causal, and collider causal sub-segments, respectively. Their outputs are then combined to produce the final prediction. Extensive experiments on multiple benchmark datasets demonstrate the effectiveness of the CAIFormer.

📄 PDF Abstract BibTeX arXiv:2505.16308

Code (0)

등록된 구현이 없습니다.

Tasks

AllMultivariate Time Series ForecastingPredictionTime SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
ADOPT Please enter a description about the method here
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Timer-XL: Long-Context Transformers for Unified Time Series Forecasting

2024-10-07 · Yong liu, Guo Qin, Xiangdong Huang, Jianmin Wang 외

We present Timer-XL, a generative Transformer for unified time series forecasting. To uniformly predict 1D and 2D time series, we generalize next token prediction, predominantly adopted for causal generation of 1D sequen…

Time SeriesTime Series Forecasting

KarmaTS: A Universal Simulation Platform for Multivariate Time Series with Functional Causal Dynamics

2025-11-14 · Haixin Li, Yanke Li, Diego Paez-Granados arxiv

We introduce KarmaTS, an interactive framework for constructing lag-indexed, executable spatiotemporal causal graphical models for multivariate time series (MTS) simulation. Motivated by the challenge of access-restricte…

Sensorformer: Cross-patch attention with global-patch compression is effective for high-dimensional multivariate time series forecasting

2025-01-06 · Liyang Qin, Xiaoli Wang, Chunhua Yang, Huaiwen Zou 외

Among the existing Transformer-based multivariate time series forecasting methods, iTransformer, which treats each variable sequence as a token and only explicitly extracts cross-variable dependencies, and PatchTST, whic…

AttributeMultivariate Time Series ForecastingTime SeriesTime Series Forecasting

Causal Discovery with Inverted Self-attention for Multivariate Time Series

2026-07-30 · Yusen Liu, Yong Wang, Yifan Yin, Tianqing Zhu 외 arxiv

Causal discovery in multivariate time series data is challenging due to complex interactions, high dimensionality, and nonlinear dependencies among variables. Existing methods often struggle to capture these complexities…

TimeMKG: Knowledge-Infused Causal Reasoning for Multivariate Time Series Modeling

2025-08-13 · Yifei Sun, Junming Liu, Yirong Chen, Xuefeng Yan 외 arxiv

Multivariate time series data typically comprises two distinct modalities: variable semantics and sampled numerical observations. Traditional time series models treat variables as anonymous statistical signals, overlooki…

Knowledge Graphs