Deep Actor-Critic Reinforcement Learning for Anomaly Detection

2019-08-28 · Chen Zhong, M. Cenk Gursoy, Senem Velipasalar

Anomaly detection is widely applied in a variety of domains, involving for instance, smart home systems, network traffic monitoring, IoT applications and sensor networks. In this paper, we study deep reinforcement learning based active sequential testing for anomaly detection. We assume that there is an unknown number of abnormal processes at a time and the agent can only check with one sensor in each sampling step. To maximize the confidence level of the decision and minimize the stopping time concurrently, we propose a deep actor-critic reinforcement learning framework that can dynamically select the sensor based on the posterior probabilities. We provide simulation results for both the training phase and testing phase, and compare the proposed framework with the Chernoff test in terms of claim delay and loss.

📄 PDF Abstract BibTeX arXiv:1908.10755

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionDeep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

ADT: Agent-based Dynamic Thresholding for Anomaly Detection

2023-12-03 · Xue Yang, Enda Howley, Micheal Schukat

The complexity and scale of IT systems are increasing dramatically, posing many challenges to real-world anomaly detection. Deep learning anomaly detection has emerged, aiming at feature learning and anomaly scoring, whi…

Anomaly Detection

Time Series Anomaly Detection via Reinforcement Learning-Based Model Selection

2022-05-19 · Jiuqi Elise Zhang, Di wu, Benoit Boulet

Time series anomaly detection has been recognized as of critical importance for the reliable and efficient operation of real-world systems. Many anomaly detection methods have been developed based on various assumptions …

Anomaly Detection Model Selection reinforcement-learning Reinforcement Learning+4

Semi-supervised Anomaly Detection via Adaptive Reinforcement Learning-Enabled Method with Causal Inference for Sensor Signals

2024-05-11 · Xiangwei Chen, Ruliang Xiaoa, Zhixia Zeng, Zhipeng Qiu 외

Semi-supervised anomaly detection for sensor signals is critical in ensuring system reliability in smart manufacturing. However, existing methods rely heavily on data correlation, neglecting causality and leading to pote…

Anomaly Detection Causal Inference counterfactual reinforcement-learning+3

Anomalous State Sequence Modeling to Enhance Safety in Reinforcement Learning

2024-07-29 · Leen Kweider, Maissa Abou Kassem, Ubai Sandouk

The deployment of artificial intelligence (AI) in decision-making applications requires ensuring an appropriate level of safety and reliability, particularly in changing environments that contain a large number of unknow…

Anomaly Detection Benchmarking Decision Making reinforcement-learning+4

Reinforcement Neighborhood Selection for Unsupervised Graph Anomaly Detection

2023-12-09 · Yuanchen Bei, Sheng Zhou, Qiaoyu Tan, Hao Xu 외

Unsupervised graph anomaly detection is crucial for various practical applications as it aims to identify anomalies in a graph that exhibit rare patterns deviating significantly from the majority of nodes. Recent advance…

Anomaly Detection Graph Anomaly Detection Representation Learning