A2Log: Attentive Augmented Log Anomaly Detection
Anomaly detection becomes increasingly important for the dependability and serviceability of IT services. As log lines record events during the execution of IT services, they are a primary source for diagnostics. Thereby, unsupervised methods provide a significant benefit since not all anomalies can be known at training time. Existing unsupervised methods need anomaly examples to obtain a suitable decision boundary required for the anomaly detection task. This requirement poses practical limitations. Therefore, we develop A2Log, which is an unsupervised anomaly detection method consisting of two steps: Anomaly scoring and anomaly decision. First, we utilize a self-attention neural network to perform the scoring for each log message. Second, we set the decision boundary based on data augmentation of the available normal training data. The method is evaluated on three publicly available datasets and one industry dataset. We show that our approach outperforms existing methods. Furthermore, we utilize available anomaly examples to set optimal decision boundaries to acquire strong baselines. We show that our approach, which determines decision boundaries without utilizing anomaly examples, can reach scores of the strong baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionData AugmentationUnsupervised Anomaly DetectionSimilar Papers 제목 키워드 기반
Self-Attentive, Multi-Context One-Class Classification for Unsupervised Anomaly Detection on Text
There exist few text-specific methods for unsupervised anomaly detection, and for those that do exist, none utilize pre-trained models for distributed vector representations of words. In this paper we introduce a new ano…
Anomaly DetectionContextual Anomaly DetectionGeneral ClassificationOne-Class Classification+2Memory Augmented Generative Adversarial Networks for Anomaly Detection
In this paper, we present a memory-augmented algorithm for anomaly detection. Classical anomaly detection algorithms focus on learning to model and generate normal data, but typically guarantees for detecting anomalous d…
Anomaly DetectionRetrieval Augmented Anomaly Detection (RAAD): Nimble Model Adjustment Without Retraining
We propose a novel mechanism for real-time (human-in-the-loop) feedback focused on false positive reduction to enhance anomaly detection models. It was designed for the lightweight deployment of a behavioral network anom…
Anomaly DetectionLightweight DeploymentRetrievalRetrieval-augmented GenerationTwin Graph-based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System
Microservice architecture has sprung up over recent years for managing enterprise applications, due to its ability to independently deploy and scale services. Despite its benefits, ensuring the reliability and safety of …
Anomaly DetectionSchedulingADFA: Attention-augmented Differentiable top-k Feature Adaptation for Unsupervised Medical Anomaly Detection
The scarcity of annotated data, particularly for rare diseases, limits the variability of training data and the range of detectable lesions, presenting a significant challenge for supervised anomaly detection in medical …
Anomaly DetectionSupervised Anomaly Detection