paper-with-me

홈 › Papers

GDformer: Going Beyond Subsequence Isolation for Multivariate Time Series Anomaly Detection

2025-01-30 · Qingxiang Liu, Chenghao Liu, Sheng Sun, Di Yao, Yuxuan Liang

Unsupervised anomaly detection of multivariate time series is a challenging task, given the requirements of deriving a compact detection criterion without accessing the anomaly points. The existing methods are mainly based on reconstruction error or association divergence, which are both confined to isolated subsequences with limited horizons, hardly promising unified series-level criterion. In this paper, we propose the Global Dictionary-enhanced Transformer (GDformer) with a renovated dictionary-based cross attention mechanism to cultivate the global representations shared by all normal points in the entire series. Accordingly, the cross-attention maps reflect the correlation weights between the point and global representations, which naturally leads to the representation-wise similarity-based detection criterion. To foster more compact detection boundary, prototypes are introduced to capture the distribution of normal point-global correlation weights. GDformer consistently achieves state-of-the-art unsupervised anomaly detection performance on five real-world benchmark datasets. Further experiments validate the global dictionary has great transferability among various datasets. The code is available at https://github.com/yuppielqx/GDformer.

📄 PDF Abstract BibTeX arXiv:2501.18196

Code (1)

yuppielqx/gdformer 공식 구현 pytorch

Tasks

Anomaly DetectionTime SeriesTime Series Anomaly DetectionUnsupervised Anomaly Detection

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Multi-Head Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음

Similar Papers 제목 키워드 기반

A Pattern Discovery Approach to Multivariate Time Series Forecasting

2022-12-20 · Yunyao Cheng, Chenjuan Guo, KaiXuan Chen, Kai Zhao 외

Multivariate time series forecasting constitutes important functionality in cyber-physical systems, whose prediction accuracy can be improved significantly by capturing temporal and multivariate correlations among multip…

DiversityMultivariate Time Series ForecastingTime SeriesTime Series Analysis+1

SGDFormer: One-stage Transformer-based Architecture for Cross-Spectral Stereo Image Guided Denoising

2024-03-30 · Runmin Zhang, Zhu Yu, Zehua Sheng, Jiacheng Ying 외

Cross-spectral image guided denoising has shown its great potential in recovering clean images with rich details, such as using the near-infrared image to guide the denoising process of the visible one. To obtain such im…

DenoisingSuper-Resolution

Clustering-based Anomaly Detection in Multivariate Time Series Data

2025-11-11 · Jinbo Li, Hesam Izakian, Witold Pedrycz, Iqbal Jamal arxiv

Multivariate time series data come as a collection of time series describing different aspects of a certain temporal phenomenon. Anomaly detection in this type of data constitutes a challenging problem yet with numerous …

Anomaly Detection

Ego-Network Transformer for Subsequence Classification in Time Series Data

2023-11-05 · Chin-Chia Michael Yeh, Huiyuan Chen, Yujie Fan, Xin Dai 외

Time series classification is a widely studied problem in the field of time series data mining. Previous research has predominantly focused on scenarios where relevant or foreground subsequences have already been extract…

Time SeriesTime Series Classification

A Shapelet Transform for Multivariate Time Series Classification

2017-12-18 · Aaron Bostrom, Anthony Bagnall

Shapelets are phase independent subsequences designed for time series classification. We propose three adaptations to the Shapelet Transform (ST) to capture multivariate features in multivariate time series classificatio…

ClassificationGeneral ClassificationTime SeriesTime Series Analysis+1