Bayesian Anomaly Detection and Classification

2019-02-22 · Ethan Roberts, Bruce A. Bassett, Michelle Lochner

Statistical uncertainties are rarely incorporated in machine learning algorithms, especially for anomaly detection. Here we present the Bayesian Anomaly Detection And Classification (BADAC) formalism, which provides a unified statistical approach to classification and anomaly detection within a hierarchical Bayesian framework. BADAC deals with uncertainties by marginalising over the unknown, true, value of the data. Using simulated data with Gaussian noise, BADAC is shown to be superior to standard algorithms in both classification and anomaly detection performance in the presence of uncertainties, though with significantly increased computational cost. Additionally, BADAC provides well-calibrated classification probabilities, valuable for use in scientific pipelines. We show that BADAC can work in online mode and is fairly robust to model errors, which can be diagnosed through model-selection methods. In addition it can perform unsupervised new class detection and can naturally be extended to search for anomalous subsets of data. BADAC is therefore ideal where computational cost is not a limiting factor and statistical rigour is important. We discuss approximations to speed up BADAC, such as the use of Gaussian processes, and finally introduce a new metric, the Rank-Weighted Score (RWS), that is particularly suited to evaluating the ability of algorithms to detect anomalies.

📄 PDF Abstract BibTeX arXiv:1902.08627

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly Detection Classification Gaussian Processes General ClassificationModel Selection

Anomaly detection in video with Bayesian nonparametrics

2016-06-27 · Olga Isupova, Danil Kuzin, Lyudmila Mihaylova

A novel dynamic Bayesian nonparametric topic model for anomaly detection in video is proposed in this paper. Batch and online Gibbs samplers are developed for inference. The paper introduces a new abnormality measure for…

Anomaly Detection Decision Making General Classification

A Bayesian Ensemble for Unsupervised Anomaly Detection

2016-10-24 · Edward Yu, Parth Parekh

Methods for unsupervised anomaly detection suffer from the fact that the data is unlabeled, making it difficult to assess the optimality of detection algorithms. Ensemble learning has shown exceptional results in classif…

Anomaly Detection Clustering Ensemble Learning General Classification+4

Low Latency Anomaly Detection and Bayesian Network Prediction of Anomaly Likelihood

2016-11-11 · Derek Farren, Thai Pham, Marco Alban-Hidalgo

We develop a supervised machine learning model that detects anomalies in systems in real time. Our model processes unbounded streams of data into time series which then form the basis of a low-latency anomaly detection m…

Anomaly Detection BIG-bench Machine Learning Time Series Time Series Analysis

Time Series Anomaly Detection for Cyber-Physical Systems via Neural System Identification and Bayesian Filtering

2021-06-15 · Cheng Feng, Pengwei Tian

Recent advances in AIoT technologies have led to an increasing popularity of utilizing machine learning algorithms to detect operational failures for cyber-physical systems (CPS). In its basic form, an anomaly detection …

Anomaly Detection Time Series Time Series Analysis Time Series Anomaly Detection

BayPrAnoMeta: Bayesian Proto-MAML for Few-Shot Industrial Image Anomaly Detection

2026-01-27 · Soham Sarkar, Tanmay Sen, Sayantan Banerjee arxiv

Industrial image anomaly detection is a challenging problem owing to extreme class imbalance and the scarcity of labeled defective samples, particularly in few-shot settings. We propose BayPrAnoMeta, a Bayesian generaliz…

Anomaly Detection