paper-with-me

홈 › Papers

Toward Supervised Anomaly Detection

2014-01-23 · Nico Goernitz, Marius Micha Kloft, Konrad Rieck, Ulf Brefeld

Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails to match the required detection rates in many tasks and there exists a need for labeled data to guide the model generation. Our first contribution shows that classical semi-supervised approaches, originating from a supervised classifier, are inappropriate and hardly detect new and unknown anomalies. We argue that semi-supervised anomaly detection needs to ground on the unsupervised learning paradigm and devise a novel algorithm that meets this requirement. Although being intrinsically non-convex, we further show that the optimization problem has a convex equivalent under relatively mild assumptions. Additionally, we propose an active learning strategy to automatically filter candidates for labeling. In an empirical study on network intrusion detection data, we observe that the proposed learning methodology requires much less labeled data than the state-of-the-art, while achieving higher detection accuracies.

📄 PDF Abstract BibTeX arXiv:1401.6424

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningAnomaly DetectionIntrusion DetectionNetwork Intrusion DetectionSemi-supervised Anomaly DetectionSupervised Anomaly DetectionUnsupervised Anomaly Detection

Similar Papers 제목 키워드 기반

UaiNets: From Unsupervised to Active Deep Anomaly Detection

2019-05-01 · ICLR 2019 5 · Tiago Pimentel, Marianne Monteiro, Juliano Viana, Adriano Veloso 외

This work presents a method for active anomaly detection which can be built upon existing deep learning solutions for unsupervised anomaly detection. We show that a prior needs to be assumed on what the anomalies are, in…

Anomaly DetectionDeep LearningUnsupervised Anomaly Detection

AGAD: Adversarial Generative Anomaly Detection

2023-04-09 · Jian Shi, Ni Zhang

Anomaly detection suffered from the lack of anomalies due to the diversity of abnormalities and the difficulties of obtaining large-scale anomaly data. Semi-supervised anomaly detection methods are often used to solely l…

Anomaly DetectionDiversitySemi-supervised Anomaly DetectionSupervised Anomaly Detection

Anomaly Detection with Inexact Labels

2019-09-11 · Tomoharu Iwata, Machiko Toyoda, Shotaro Tora, Naonori Ueda

We propose a supervised anomaly detection method for data with inexact anomaly labels, where each label, which is assigned to a set of instances, indicates that at least one instance in the set is anomalous. Although man…

Anomaly DetectionMultiple Instance LearningSupervised Anomaly DetectionUnsupervised Anomaly Detection

Understanding Bias in Anomaly Detection: A Semi-Supervised View with PAC Guarantees

2021-01-01 · Ziyu Ye, Yuxin Chen, Haitao Zheng

Anomaly detection presents a unique challenge in machine learning, due to the scarcity of labeled anomaly data. Existing work attempts to mitigate such problems via semi-supervised learning, i.e., augmenting unsupervised…

Anomaly DetectionSemi-supervised Anomaly DetectionSupervised Anomaly DetectionUnsupervised Anomaly Detection

PAC-Wrap: Semi-Supervised PAC Anomaly Detection

2022-05-22 · Shuo Li, Xiayan Ji, Edgar Dobriban, Oleg Sokolsky 외

Anomaly detection is essential for preventing hazardous outcomes for safety-critical applications like autonomous driving. Given their safety-criticality, these applications benefit from provable bounds on various errors…

Anomaly DetectionAutonomous DrivingUnsupervised Anomaly Detection