paper-with-me

홈 › Papers

CATS: Mitigating Correlation Shift for Multivariate Time Series Classification

2025-04-05 · Xiao Lin, Zhichen Zeng, Tianxin Wei, Zhining Liu, Yuzhong Chen, Hanghang Tong

Unsupervised Domain Adaptation (UDA) leverages labeled source data to train models for unlabeled target data. Given the prevalence of multivariate time series (MTS) data across various domains, the UDA task for MTS classification has emerged as a critical challenge. However, for MTS data, correlations between variables often vary across domains, whereas most existing UDA works for MTS classification have overlooked this essential characteristic. To bridge this gap, we introduce a novel domain shift, {\em correlation shift}, measuring domain differences in multivariate correlation. To mitigate correlation shift, we propose a scalable and parameter-efficient \underline{C}orrelation \underline{A}dapter for M\underline{TS} (CATS). Designed as a plug-and-play technique compatible with various Transformer variants, CATS employs temporal convolution to capture local temporal patterns and a graph attention module to model the changing multivariate correlation. The adapter reweights the target correlations to align the source correlations with a theoretically guaranteed precision. A correlation alignment loss is further proposed to mitigate correlation shift, bypassing the alignment challenge from the non-i.i.d. nature of MTS data. Extensive experiments on four real-world datasets demonstrate that (1) compared with vanilla Transformer-based models, CATS increases over $10\%$ average accuracy while only adding around $1\%$ parameters, and (2) all Transformer variants equipped with CATS either reach or surpass state-of-the-art baselines.

📄 PDF Abstract BibTeX arXiv:2504.04283

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationGraph AttentionTime SeriesTime Series ClassificationUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음
MTS 설명 없음
Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

CATS: Enhancing Multivariate Time Series Forecasting by Constructing Auxiliary Time Series as Exogenous Variables

2024-03-04 · Jiecheng Lu, Xu Han, Yan Sun, Shihao Yang

For Multivariate Time Series Forecasting (MTSF), recent deep learning applications show that univariate models frequently outperform multivariate ones. To address the difficiency in multivariate models, we introduce a me…

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting

Discover and Cure: Concept-aware Mitigation of Spurious Correlation

2023-05-01 · Shirley Wu, Mert Yuksekgonul, Linjun Zhang, James Zou

Deep neural networks often rely on spurious correlations to make predictions, which hinders generalization beyond training environments. For instance, models that associate cats with bed backgrounds can fail to predict t…

Lesion ClassificationObject RecognitionSkin Lesion Classification

The Multivariate Mixture Dynamics Model: Shifted dynamics and correlation skew

2018-10-31

The Multi Variate Mixture Dynamics model is a tractable, dynamical, arbitrage-free multivariate model characterized by transparency on the dependence structure, since closed form formulae for terminal correlations, avera…

Temporal Query Network for Efficient Multivariate Time Series Forecasting

2025-05-19 · Shengsheng Lin, Haojun Chen, Haijie Wu, Chunyun Qiu 외

Sufficiently modeling the correlations among variables (aka channels) is crucial for achieving accurate multivariate time series forecasting (MTSF). In this paper, we propose a novel technique called Temporal Query (TQ) …

Correlated Time Series ForecastingMultivariate Time Series ForecastingTime SeriesTime Series Forecasting

Robust Multivariate Time Series Forecasting against Intra- and Inter-Series Transitional Shift

2024-07-18 · Hui He, Qi Zhang, Kun Yi, Xiaojun Xue 외

The non-stationary nature of real-world Multivariate Time Series (MTS) data presents forecasting models with a formidable challenge of the time-variant distribution of time series, referred to as distribution shift. Exis…

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting