Incorporating Privileged Information to Unsupervised Anomaly Detection

2018-05-06 · Shubhranshu Shekhar, Leman Akoglu

We introduce a new unsupervised anomaly detection ensemble called SPI which can harness privileged information - data available only for training examples but not for (future) test examples. Our ideas build on the Learning Using Privileged Information (LUPI) paradigm pioneered by Vapnik et al. [19,17], which we extend to unsupervised learning and in particular to anomaly detection. SPI (for Spotting anomalies with Privileged Information) constructs a number of frames/fragments of knowledge (i.e., density estimates) in the privileged space and transfers them to the anomaly scoring space through "imitation" functions that use only the partial information available for test examples. Our generalization of the LUPI paradigm to unsupervised anomaly detection shepherds the field in several key directions, including (i) domain knowledge-augmented detection using expert annotations as PI, (ii) fast detection using computationally-demanding data as PI, and (iii) early detection using "historical future" data as PI. Through extensive experiments on simulated and real datasets, we show that augmenting privileged information to anomaly detection significantly improves detection performance. We also demonstrate the promise of SPI under all three settings (i-iii); with PI capturing expert knowledge, computationally expensive features, and future data on three real world detection tasks.

📄 PDF Abstract BibTeX arXiv:1805.02269

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly Detection Unsupervised Anomaly Detection

Anomaly Detection with Inexact Labels

2019-09-11 · Tomoharu Iwata, Machiko Toyoda, Shotaro Tora, Naonori Ueda

We propose a supervised anomaly detection method for data with inexact anomaly labels, where each label, which is assigned to a set of instances, indicates that at least one instance in the set is anomalous. Although man…

Anomaly Detection Multiple Instance Learning Supervised Anomaly Detection Unsupervised Anomaly Detection

CL-Flow:Strengthening the Normalizing Flows by Contrastive Learning for Better Anomaly Detection

2023-11-12 · Shunfeng Wang, Yueyang Li, Haichi Luo, Chenyang Bi

In the anomaly detection field, the scarcity of anomalous samples has directed the current research emphasis towards unsupervised anomaly detection. While these unsupervised anomaly detection methods offer convenience, t…

Anomaly Detection Contrastive Learning Self-Supervised Anomaly Detection Supervised Anomaly Detection+1

DDR-ID: Dual Deep Reconstruction Networks Based Image Decomposition for Anomaly Detection

2020-07-18 · Dongyun Lin, Yiqun Li, Shudong Xie, Tin Lay Nwe 외

One pivot challenge for image anomaly (AD) detection is to learn discriminative information only from normal class training images. Most image reconstruction based AD methods rely on the discriminative capability of reco…

Adversarial Attack Adversarial Attack Detection Anomaly Detection Benchmarking+1

One-Class SVM with Privileged Information and its Application to Malware Detection

2016-09-26 · Evgeny Burnaev, Dmitry Smolyakov

A number of important applied problems in engineering, finance and medicine can be formulated as a problem of anomaly detection. A classical approach to the problem is to describe a normal state using a one-class support…

Anomaly Detection Classification General Classification Malware Classification+2

Impact of Inaccurate Contamination Ratio on Robust Unsupervised Anomaly Detection

2024-08-14 · Jordan F. Masakuna, DJeff Kanda Nkashama, Arian Soltani, Marc Frappier 외

Training data sets intended for unsupervised anomaly detection, typically presumed to be anomaly-free, often contain anomalies (or contamination), a challenge that significantly undermines model performance. Most robust …

Anomaly Detection Misinformation Unsupervised Anomaly Detection