paper-with-me

홈 › Papers

PatchTrAD: A Patch-Based Transformer focusing on Patch-Wise Reconstruction Error for Time Series Anomaly Detection

2025-04-10 · Samy-Melwan Vilhes, Gilles Gasso, Mokhtar Z Alaya

Time series anomaly detection (TSAD) focuses on identifying whether observations in streaming data deviate significantly from normal patterns. With the prevalence of connected devices, anomaly detection on time series has become paramount, as it enables real-time monitoring and early detection of irregular behaviors across various application domains. In this work, we introduce PatchTrAD, a Patch-based Transformer model for time series anomaly detection. Our approach leverages a Transformer encoder along with the use of patches under a reconstructionbased framework for anomaly detection. Empirical evaluations on multiple benchmark datasets show that PatchTrAD is on par, in terms of detection performance, with state-of-the-art deep learning models for anomaly detection while being time efficient during inference.

📄 PDF Abstract BibTeX arXiv:2504.08827

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionTime SeriesTime Series Anomaly Detection

Methods 이 논문이 사용한 방법론

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Transformer A Transformer is a model architecture that eschews recurrence and instead relies entirely on an [attention…

Similar Papers 제목 키워드 기반

Are Vision Transformers Robust to Patch-wise Perturbations?

2021-09-29 · Jindong Gu, Volker Tresp, Yao Qin

The recent advances in Vision Transformer (ViT) have demonstrated its impressive performance in image classification, which makes it a promising alternative to Convolutional Neural Network (CNN). Unlike CNNs, ViT represe…

image-classificationImage Classification

Are Vision Transformers Robust to Patch Perturbations?

2021-11-20 · Jindong Gu, Volker Tresp, Yao Qin

Recent advances in Vision Transformer (ViT) have demonstrated its impressive performance in image classification, which makes it a promising alternative to Convolutional Neural Network (CNN). Unlike CNNs, ViT represents …

image-classificationImage Classification

KNN Local Attention for Image Restoration

2022-01-01 · CVPR 2022 1 · Hunsang Lee, Hyesong Choi, Kwanghoon Sohn, Dongbo Min

Recent works attempt to integrate the non-local operation with CNNs or Transformer, achieving remarkable performance in image restoration tasks. The global similarity, however, has the problems of the lack of localit…

DeblurringDenoisingImage DenoisingImage Restoration+2

Patch Transformer for Multi-tagging Whole Slide Histopathology Images

2019-06-10 · Weijian Li, Viet-Duy Nguyen, Haofu Liao, Matt Wilder 외

Automated whole slide image (WSI) tagging has become a growing demand due to the increasing volume and diversity of WSIs collected nowadays in histopathology. Various methods have been studied to classify WSIs with singl…

DiversityTAG

IPatch: A Multi-Resolution Transformer Architecture for Robust Time-Series Forecasting

2026-03-25 · Aymane Harkati, Moncef Garouani, Olivier Teste, Julien Aligon 외 arxiv

Accurate forecasting of multivariate time series remains challenging due to the need to capture both short-term fluctuations and long-range temporal dependencies. Transformer-based models have emerged as a powerful appro…