Toward Deep Supervised Anomaly Detection: Reinforcement Learning from Partially Labeled Anomaly Data
We consider the problem of anomaly detection with a small set of partially labeled anomaly examples and a large-scale unlabeled dataset. This is a common scenario in many important applications. Existing related methods either exclusively fit the limited anomaly examples that typically do not span the entire set of anomalies, or proceed with unsupervised learning from the unlabeled data. We propose here instead a deep reinforcement learning-based approach that enables an end-to-end optimization of the detection of both labeled and unlabeled anomalies. This approach learns the known abnormality by automatically interacting with an anomaly-biased simulation environment, while continuously extending the learned abnormality to novel classes of anomaly (i.e., unknown anomalies) by actively exploring possible anomalies in the unlabeled data. This is achieved by jointly optimizing the exploitation of the small labeled anomaly data and the exploration of the rare unlabeled anomalies. Extensive experiments on 48 real-world datasets show that our model significantly outperforms five state-of-the-art competing methods.
Code (2)
Tasks
Anomaly DetectionDeep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Supervised Anomaly DetectionSimilar Papers 제목 키워드 기반
Deep Anomaly Detection and Search via Reinforcement Learning
Semi-supervised Anomaly Detection (AD) is a kind of data mining task which aims at learning features from partially-labeled datasets to help detect outliers. In this paper, we classify existing semi-supervised AD methods…
Anomaly DetectionEnsemble LearningPartially Labeled Datasetsreinforcement-learning+4SPADE: Semi-supervised Anomaly Detection under Distribution Mismatch
Semi-supervised anomaly detection is a common problem, as often the datasets containing anomalies are partially labeled. We propose a canonical framework: Semi-supervised Pseudo-labeler Anomaly Detection with Ensembling …
Anomaly DetectionSemi-supervised Anomaly DetectionSupervised Anomaly DetectionUnsupervised Model Selection for Time-series Anomaly Detection
Anomaly detection in time-series has a wide range of practical applications. While numerous anomaly detection methods have been proposed in the literature, a recent survey concluded that no single method is the most accu…
Anomaly DetectionmodelModel SelectionSupervised Anomaly Detection+3Self-supervise, Refine, Repeat: Improving Unsupervised Anomaly Detection
Anomaly detection (AD), separating anomalies from normal data, has many applications across domains, from security to healthcare. While most previous works were shown to be effective for cases with fully or partially lab…
Anomaly DetectionClassificationOne-Class ClassificationOne-class classifier+2Semi-supervised learning via DQN for log anomaly detection
Log anomaly detection is a critical component in modern software system security and maintenance, serving as a crucial support and basis for system monitoring, operation, and troubleshooting. It aids operations personnel…
Anomaly DetectionDeep Reinforcement Learningreinforcement-learningSupervised Anomaly Detection