Categorical anomaly detection in heterogeneous data using minimum description length clustering
Fast and effective unsupervised anomaly detection algorithms have been proposed for categorical data based on the minimum description length (MDL) principle. However, they can be ineffective when detecting anomalies in heterogeneous datasets representing a mixture of different sources, such as security scenarios in which system and user processes have distinct behavior patterns. We propose a meta-algorithm for enhancing any MDL-based anomaly detection model to deal with heterogeneous data by fitting a mixture model to the data, via a variant of k-means clustering. Our experimental results show that using a discrete mixture model provides competitive performance relative to two previous anomaly detection algorithms, while mixtures of more sophisticated models yield further gains, on both synthetic datasets and realistic datasets from a security scenario.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionClusteringUnsupervised Anomaly DetectionSimilar Papers 제목 키워드 기반
Detecting Anomalies Through Contrast in Heterogeneous Data
Detecting anomalies has been a fundamental approach in detecting potentially fraudulent activities. Tasked with detection of illegal timber trade that threatens ecosystems and economies and association with other illegal…
Anomaly DetectionContrastive LearningUnsupervised Anomaly DetectionEntity Embedding-based Anomaly Detection for Heterogeneous Categorical Events
Anomaly detection plays an important role in modern data-driven security applications, such as detecting suspicious access to a socket from a process. In many cases, such events can be described as a collection of catego…
Anomaly DetectionMulti-Aspect Mining and Anomaly Detection for Heterogeneous Tensor Streams
Analysis and anomaly detection in event tensor streams consisting of timestamps and multiple attributes - such as communication logs(time, IP address, packet length)- are essential tasks in data mining. While existing te…
Anomaly DetectionHFN: Heterogeneous Feature Network for Multivariate Time Series Anomaly Detection
Network or physical attacks on industrial equipment or computer systems may cause massive losses. Therefore, a quick and accurate anomaly detection (AD) based on monitoring data, especially the multivariate time-series (…
Anomaly DetectionGraph structure learningRepresentation LearningSemi-supervised Anomaly Detection+4Anomaly Detection and Localisation using Mixed Graphical Models
We propose a method that performs anomaly detection and localisation within heterogeneous data using a pairwise undirected mixed graphical model. The data are a mixture of categorical and quantitative variables, and the …
Anomaly Detection