LLM-Enhanced Reinforcement Learning for Time Series Anomaly Detection
Detecting anomalies in time series data is crucial for finance, healthcare, sensor networks, and industrial monitoring applications. However, time series anomaly detection often suffers from sparse labels, complex temporal patterns, and costly expert annotation. We propose a unified framework that integrates Large Language Model (LLM)-based potential functions for reward shaping with Reinforcement Learning (RL), Variational Autoencoder (VAE)-enhanced dynamic reward scaling, and active learning with label propagation. An LSTM-based RL agent leverages LLM-derived semantic rewards to guide exploration, while VAE reconstruction errors add unsupervised anomaly signals. Active learning selects the most uncertain samples, and label propagation efficiently expands labeled data. Evaluations on Yahoo-A1 and SMD benchmarks demonstrate that our method achieves state-of-the-art detection accuracy under limited labeling budgets and operates effectively in data-constrained settings. This study highlights the promise of combining LLMs with RL and advanced unsupervised techniques for robust, scalable anomaly detection in real-world applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Time Series Anomaly DetectionReinforcement LearningActive LearningSimilar Papers 제목 키워드 기반
SPEAR: Soft Prompt Enhanced Anomaly Recognition for Time Series Data
Time series anomaly detection plays a crucial role in a wide range of fields, such as healthcare and internet traffic monitoring. The emergence of large language models (LLMs) offers new opportunities for detecting anoma…
Time Series Anomaly DetectionDynamic Reward Scaling for Multivariate Time Series Anomaly Detection: A VAE-Enhanced Reinforcement Learning Approach
Detecting anomalies in multivariate time series is essential for monitoring complex industrial systems, where high dimensionality, limited labeled data, and subtle dependencies between sensors cause significant challenge…
Time Series Anomaly DetectionAnomaly ClassificationReinforcement LearningActive LearningTime Series Anomaly Detection via Reinforcement Learning-Based Model Selection
Time series anomaly detection has been recognized as of critical importance for the reliable and efficient operation of real-world systems. Many anomaly detection methods have been developed based on various assumptions …
Anomaly DetectionModel Selectionreinforcement-learningReinforcement Learning+4Towards Experienced Anomaly Detector through Reinforcement Learning
This abstract proposes a time series anomaly detector which 1) makes no assumption about the underlying mechanism of anomaly patterns, 2) refrains from the cumbersome work of threshold setting for good anomaly detection …
Anomaly Detectionreinforcement-learningReinforcement LearningReinforcement Learning (RL)+4Periodic Graph-Enhanced Multivariate Time Series Anomaly Detector
Multivariate time series (MTS) anomaly detection commonly encounters in various domains like finance, healthcare, and industrial monitoring. However, existing MTS anomaly detection methods are mostly defined on the stati…
Graph Neural NetworkAnomaly Detection