Temporal Query Network for Efficient Multivariate Time Series Forecasting

2025-05-19 · Shengsheng Lin, Haojun Chen, Haijie Wu, Chunyun Qiu, Weiwei Lin

Sufficiently modeling the correlations among variables (aka channels) is crucial for achieving accurate multivariate time series forecasting (MTSF). In this paper, we propose a novel technique called Temporal Query (TQ) to more effectively capture multivariate correlations, thereby improving model performance in MTSF tasks. Technically, the TQ technique employs periodically shifted learnable vectors as queries in the attention mechanism to capture global inter-variable patterns, while the keys and values are derived from the raw input data to encode local, sample-level correlations. Building upon the TQ technique, we develop a simple yet efficient model named Temporal Query Network (TQNet), which employs only a single-layer attention mechanism and a lightweight multi-layer perceptron (MLP). Extensive experiments demonstrate that TQNet learns more robust multivariate correlations, achieving state-of-the-art forecasting accuracy across 12 challenging real-world datasets. Furthermore, TQNet achieves high efficiency comparable to linear-based methods even on high-dimensional datasets, balancing performance and computational cost. The code is available at: https://github.com/ACAT-SCUT/TQNet.

📄 PDF Abstract BibTeX arXiv:2505.12917

Code (1)

ACAT-SCUT/TQNet 공식 구현 pytorch

Tasks

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

SCFormer: Structured Channel-wise Transformer with Cumulative Historical State for Multivariate Time Series Forecasting

2025-05-05 · Shiwei Guo, Ziang Chen, Yupeng Ma, Yunfei Han 외

The Transformer model has shown strong performance in multivariate time series forecasting by leveraging channel-wise self-attention. However, this approach lacks temporal constraints when computing temporal features and…

Multivariate Time Series Forecasting Time Series Time Series Forecasting

ASTGI: Adaptive Spatio-Temporal Graph Interactions for Irregular Multivariate Time Series Forecasting

2025-09-27 · Xvyuan Liu, Xiangfei Qiu, Hanyin Cheng, Xingjian Wu 외 arxiv

Irregular multivariate time series (IMTS) are prevalent in critical domains like healthcare and finance, where accurate forecasting is vital for proactive decision-making. However, the asynchronous sampling and irregular…

Multivariate Time Series Forecasting

Temporal Latent Auto-Encoder: A Method for Probabilistic Multivariate Time Series Forecasting

2021-01-25 · Nam Nguyen, Brian Quanz

Probabilistic forecasting of high dimensional multivariate time series is a notoriously challenging task, both in terms of computational burden and distribution modeling. Most previous work either makes simple distributi…

Decoder Deep Learning Multivariate Time Series Forecasting Time Series+2

Series Saliency: Temporal Interpretation for Multivariate Time Series Forecasting

2020-12-16 · Qingyi Pan, WenBo Hu, Jun Zhu

Time series forecasting is an important yet challenging task. Though deep learning methods have recently been developed to give superior forecasting results, it is crucial to improve the interpretability of time series m…

Data Augmentation Multivariate Time Series Forecasting Time Series Time Series Analysis+1

SAGDFN: A Scalable Adaptive Graph Diffusion Forecasting Network for Multivariate Time Series Forecasting

2024-06-18 · Yue Jiang, Xiucheng Li, Yile Chen, Shuai Liu 외

Time series forecasting is essential for our daily activities and precise modeling of the complex correlations and shared patterns among multiple time series is essential for improving forecasting performance. Spatial-Te…