paper-with-me

홈 › Papers

Leveraging Intermediate Representations of Time Series Foundation Models for Anomaly Detection

2025-09-16 · Chan Sik Han, Keon Myung Lee arxiv

Detecting anomalies in time series data is essential for the reliable operation of many real-world systems. Recently, time series foundation models (TSFMs) have emerged as a powerful tool for anomaly detection. However, existing methods typically rely on the final layer's representations of TSFMs, computing the anomaly score as a reconstruction or forecasting error via a task-specific head. Instead, we propose TimeRep, a novel anomaly detection approach that leverages the intermediate layer's representations of TSFMs, computing the anomaly score as the distance between these representations. Given a pre-trained TSFM, TimeRep selects the intermediate layer and patch-token position that yield the most informative representation. TimeRep forms a reference collection of intermediate representations from the training data and applies a core-set strategy to reduce its size while maintaining distributional coverage. During inference, TimeRep computes the anomaly score for incoming data by measuring the distance between its intermediate representations and those of the collection. To address concept drift, TimeRep integrates an adaptation mechanism that, at inference time, augments the collection exclusively with non-redundant intermediate representations from incoming data. We conducted extensive experiments on the UCR Anomaly Archive, which contains 250 univariate time series. TimeRep consistently outperforms a broad spectrum of state-of-the-art baselines, including non-DL, DL, and foundation model-based methods.

📄 PDF Abstract BibTeX arXiv:2509.12650

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly Detection

Similar Papers 제목 키워드 기반

Mitigating Data Scarcity in Time Series Analysis: A Foundation Model with Series-Symbol Data Generation

2025-02-21 · Wenxuan Wang, Kai Wu, Yujian Betterest Li, Dan Wang 외

Foundation models for time series analysis (TSA) have attracted significant attention. However, challenges such as data scarcity and data imbalance continue to hinder their development. To address this, we consider model…

Time SeriesTime Series Analysis

Time Series Representations for Classification Lie Hidden in Pretrained Vision Transformers

2025-06-10 · Simon Roschmann, Quentin Bouniot, Vasilii Feofanov, Ievgen Redko 외

Time series classification is a fundamental task in healthcare and industry, yet the development of time series foundation models (TSFMs) remains limited by the scarcity of publicly available time series datasets. In thi…

Time SeriesTime Series Classification

MoTM: Towards a Foundation Model for Time Series Imputation based on Continuous Modeling

2025-07-17 · Etienne Le Naour, Tahar Nabil, Ghislain Agoua

Recent years have witnessed a growing interest for time series foundation models, with a strong emphasis on the forecasting task. Yet, the crucial task of out-of-domain imputation of missing values remains largely undere…

Domain GeneralizationImputationMissing ValuesTime Series

WaveMoE: A Wavelet-Enhanced Mixture-of-Experts Foundation Model for Time Series Forecasting

2026-04-12 · Shunyu Wu, Jiawei Huang, Weibin Feng, Boxin Li 외 arxiv

Time series foundation models (TSFMs) have recently achieved remarkable success in universal forecasting by leveraging large-scale pretraining on diverse time series data. Complementing this progress, incorporating frequ…

Time Series Forecasting

MantisV2: Closing the Zero-Shot Gap in Time Series Classification with Synthetic Data and Test-Time Strategies

2026-02-19 · Vasilii Feofanov, Songkang Wen, Jianfeng Zhang, Lujia Pan 외 arxiv

Developing foundation models for time series classification is of high practical relevance, as such models can serve as universal feature extractors for diverse downstream tasks. Although early models such as Mantis have…

Time Series ClassificationHuman Activity Recognition