Bayesian Anomaly Detection Using Extreme Value Theory
Data-driven anomaly detection methods typically build a model for the normal behavior of the target system, and score each data instance with respect to this model. A threshold is invariably needed to identify data instances with high (or low) scores as anomalies. This presents a practical limitation on the applicability of such methods, since most methods are sensitive to the choice of the threshold, and it is challenging to set optimal thresholds. We present a probabilistic framework to explicitly model the normal and anomalous behaviors and probabilistically reason about the data. An extreme value theory based formulation is proposed to model the anomalous behavior as the extremes of the normal behavior. As a specific instantiation, a joint non-parametric clustering and anomaly detection algorithm is proposed that models the normal behavior as a Dirichlet Process Mixture Model.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionClusteringSimilar Papers 제목 키워드 기반
LSTM-Based Anomaly Detection: Detection Rules from Extreme Value Theory
In this paper, we explore various statistical techniques for anomaly detection in conjunction with the popular Long Short-Term Memory (LSTM) deep learning model for transportation networks. We obtain the prediction error…
Anomaly DetectionPredictionSparse Representation of Multivariate Extremes with Applications to Anomaly Ranking
Extremes play a special role in Anomaly Detection. Beyond inference and simulation purposes, probabilistic tools borrowed from Extreme Value Theory (EVT), such as the angular measure, can also be used to design novel sta…
Anomaly DetectionDimensionality ReductionExtreme Value Modelling of Feature Residuals for Anomaly Detection in Dynamic Graphs
Detecting anomalies in a temporal sequence of graphs can be applied is areas such as the detection of accidents in transport networks and cyber attacks in computer networks. Existing methods for detecting abnormal graphs…
Anomaly DetectionTime SeriesTime Series AnalysisA Framework for End-to-End Deep Learning-Based Anomaly Detection in Transportation Networks
We develop an end-to-end deep learning-based anomaly detection model for temporal data in transportation networks. The proposed EVT-LSTM model is derived from the popular LSTM (Long Short-Term Memory) network and adopts …
Anomaly DetectionBIG-bench Machine LearningDeep LearningExtrapolation in Statistical Learning with Extreme Value Theory
Extreme value theory provides rigorous theory and statistical tools for extrapolation in machine learning, particularly in settings where traditional methods struggle due to data scarcity in the tails. A broad range of t…
Anomaly Detection