Toward Supervised Anomaly Detection
Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails to match the required detection rates in many tasks and there exists a need for labeled data to guide the model generation. Our first contribution shows that classical semi-supervised approaches, originating from a supervised classifier, are inappropriate and hardly detect new and unknown anomalies. We argue that semi-supervised anomaly detection needs to ground on the unsupervised learning paradigm and devise a novel algorithm that meets this requirement. Although being intrinsically non-convex, we further show that the optimization problem has a convex equivalent under relatively mild assumptions. Additionally, we propose an active learning strategy to automatically filter candidates for labeling. In an empirical study on network intrusion detection data, we observe that the proposed learning methodology requires much less labeled data than the state-of-the-art, while achieving higher detection accuracies.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningAnomaly DetectionIntrusion DetectionNetwork Intrusion DetectionSemi-supervised Anomaly DetectionSupervised Anomaly DetectionUnsupervised Anomaly DetectionSimilar Papers 제목 키워드 기반
UaiNets: From Unsupervised to Active Deep Anomaly Detection
This work presents a method for active anomaly detection which can be built upon existing deep learning solutions for unsupervised anomaly detection. We show that a prior needs to be assumed on what the anomalies are, in…
Anomaly DetectionDeep LearningUnsupervised Anomaly DetectionAGAD: Adversarial Generative Anomaly Detection
Anomaly detection suffered from the lack of anomalies due to the diversity of abnormalities and the difficulties of obtaining large-scale anomaly data. Semi-supervised anomaly detection methods are often used to solely l…
Anomaly DetectionDiversitySemi-supervised Anomaly DetectionSupervised Anomaly DetectionAnomaly Detection with Inexact Labels
We propose a supervised anomaly detection method for data with inexact anomaly labels, where each label, which is assigned to a set of instances, indicates that at least one instance in the set is anomalous. Although man…
Anomaly DetectionMultiple Instance LearningSupervised Anomaly DetectionUnsupervised Anomaly DetectionUnderstanding Bias in Anomaly Detection: A Semi-Supervised View with PAC Guarantees
Anomaly detection presents a unique challenge in machine learning, due to the scarcity of labeled anomaly data. Existing work attempts to mitigate such problems via semi-supervised learning, i.e., augmenting unsupervised…
Anomaly DetectionSemi-supervised Anomaly DetectionSupervised Anomaly DetectionUnsupervised Anomaly DetectionPAC-Wrap: Semi-Supervised PAC Anomaly Detection
Anomaly detection is essential for preventing hazardous outcomes for safety-critical applications like autonomous driving. Given their safety-criticality, these applications benefit from provable bounds on various errors…
Anomaly DetectionAutonomous DrivingUnsupervised Anomaly Detection