A Taxonomy of Anomalies in Log Data
Log data anomaly detection is a core component in the area of artificial intelligence for IT operations. However, the large amount of existing methods makes it hard to choose the right approach for a specific system. A better understanding of different kinds of anomalies, and which algorithms are suitable for detecting them, would support researchers and IT operators. Although a common taxonomy for anomalies already exists, it has not yet been applied specifically to log data, pointing out the characteristics and peculiarities in this domain. In this paper, we present a taxonomy for different kinds of log data anomalies and introduce a method for analyzing such anomalies in labeled datasets. We applied our taxonomy to the three common benchmark datasets Thunderbird, Spirit, and BGL, and trained five state-of-the-art unsupervised anomaly detection algorithms to evaluate their performance in detecting different kinds of anomalies. Our results show, that the most common anomaly type is also the easiest to predict. Moreover, deep learning-based approaches outperform data mining-based approaches in all anomaly types, but especially when it comes to detecting contextual anomalies.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionUnsupervised Anomaly DetectionSimilar Papers 제목 키워드 기반
Anomaly Detection and Classification in Knowledge Graphs
Anomalies such as redundant, inconsistent, contradictory, and deficient values in a Knowledge Graph (KG) are unavoidable, as these graphs are often curated manually, or extracted using machine learning and natural langua…
Anomaly DetectionClassificationKnowledge GraphsLearning-Based Link Anomaly Detection in Continuous-Time Dynamic Graphs
Anomaly detection in continuous-time dynamic graphs is an emerging field yet under-explored in the context of learning algorithms. In this paper, we pioneer structured analyses of link-level anomalies and graph represent…
Anomaly DetectionGraph LearningGraph Representation LearningLink Prediction+1Identifying Pediatric Vascular Anomalies With Deep Learning
Vascular anomalies, more colloquially known as birthmarks, affect up to 1 in 10 infants. Though many of these lesions self-resolve, some types can result in medical complications or disfigurement without proper diagnosis…
Deep LearningDiagnosticManagement‘Unexpected item in the bagging area’: Anomaly Detection in X-ray Security Images
The role of Anomaly Detection in X-ray security imaging, as a supplement to targeted threat detection, is described; and a taxonomy of anomalies types in this domain is presented. Algorithms are described for detectin…
Anomaly DetectionRedefining Maritime Anomaly Detection via Equation-Grounded Synthetic Anomalies
Maritime anomaly detection is essential for ensuring maritime safety, security, and efficient traffic management at sea, with Automatic Identification System (AIS) data serving as a primary data source. Despite its impor…
Anomaly Detection