paper-with-me

홈 › Papers

CVTN: Cross Variable and Temporal Integration for Time Series Forecasting

2024-04-29 · Han Zhou, Yuntian Chen

In multivariate time series forecasting, the Transformer architecture encounters two significant challenges: effectively mining features from historical sequences and avoiding overfitting during the learning of temporal dependencies. To tackle these challenges, this paper deconstructs time series forecasting into the learning of historical sequences and prediction sequences, introducing the Cross-Variable and Time Network (CVTN). This unique method divides multivariate time series forecasting into two phases: cross-variable learning for effectively mining fea tures from historical sequences, and cross-time learning to capture the temporal dependencies of prediction sequences. Separating these two phases helps avoid the impact of overfitting in cross-time learning on cross-variable learning. Exten sive experiments on various real-world datasets have confirmed its state-of-the-art (SOTA) performance. CVTN emphasizes three key dimensions in time series fore casting: the short-term and long-term nature of time series (locality and longevity), feature mining from both historical and prediction sequences, and the integration of cross-variable and cross-time learning. This approach not only advances the current state of time series forecasting but also provides a more comprehensive framework for future research in this field.

📄 PDF Abstract BibTeX arXiv:2404.18730

Code (0)

등록된 구현이 없습니다.

Tasks

Multivariate Time Series ForecastingPredictionTime SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Data

2023-02-03 · Junyi Ma, Guangming Xiong, Jingyi Xu, Xieyuanli Chen

LiDAR-based place recognition (LPR) is one of the most crucial components of autonomous vehicles to identify previously visited places in GPS-denied environments. Most existing LPR methods use mundane representations of …

Autonomous Vehicles

Understanding Adaptive, Multiscale Temporal Integration In Deep Speech Recognition Systems

2021-12-01 · NeurIPS 2021 12 · Menoua Keshishian, Samuel Norman-Haignere, Nima Mesgarani

Natural signals such as speech are hierarchically structured across many different timescales, spanning tens (e.g., phonemes) to hundreds (e.g., words) of milliseconds, each of which is highly variable and context-depend…

speech-recognitionSpeech Recognition

Spatiotemporal Impact of Trade Policy Variables on Asian Manufacturing Hubs: Bayesian Global Vector Autoregression Model

2025-03-22 · Lutfu S. Sua, Haibo Wang, Jun Huang

A novel spatiotemporal framework using diverse econometric approaches is proposed in this research to analyze relationships among eight economy-wide variables in varying market conditions. Employing Vector Autoregression…

Time Series

Transforming Causality: Transformer-Based Temporal Causal Discovery with Prior Knowledge Integration

2025-08-21 · Jihua Huang, Yi Yao, Ajay Divakaran arxiv

We introduce a novel framework for temporal causal discovery and inference that addresses two key challenges: complex nonlinear dependencies and spurious correlations. Our approach employs a multi-layer Transformer-based…

Enhancing Multivariate Time Series Forecasting with Mutual Information-driven Cross-Variable and Temporal Modeling

2024-03-01 · shiyi qi, Liangjian Wen, Yiduo Li, Yuanhang Yang 외

Recent advancements have underscored the impact of deep learning techniques on multivariate time series forecasting (MTSF). Generally, these techniques are bifurcated into two categories: Channel-independence and Channel…

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting