Practical Anomaly Detection over Multivariate Monitoring Metrics for Online Services
As modern software systems continue to grow in terms of complexity and volume, anomaly detection on multivariate monitoring metrics, which profile systems' health status, becomes more and more critical and challenging. In particular, the dependency between different metrics and their historical patterns plays a critical role in pursuing prompt and accurate anomaly detection. Existing approaches fall short of industrial needs for being unable to capture such information efficiently. To fill this significant gap, in this paper, we propose CMAnomaly, an anomaly detection framework on multivariate monitoring metrics based on collaborative machine. The proposed collaborative machine is a mechanism to capture the pairwise interactions along with feature and temporal dimensions with linear time complexity. Cost-effective models can then be employed to leverage both the dependency between monitoring metrics and their historical patterns for anomaly detection. The proposed framework is extensively evaluated with both public data and industrial data collected from a large-scale online service system of Huawei Cloud. The experimental results demonstrate that compared with state-of-the-art baseline models, CMAnomaly achieves an average F1 score of 0.9494, outperforming baselines by 6.77% to 10.68%, and runs 10X to 20X faster. Furthermore, we also share our experience of deploying CMAnomaly in Huawei Cloud.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Ymir: A Supervised Ensemble Framework for Multivariate Time Series Anomaly Detection
We proposed a multivariate time series anomaly detection frame-work Ymir, which leverages ensemble learning and supervisedlearning technology to efficiently learn and adapt to anomaliesin real-world system applications. …
Anomaly DetectionEnsemble LearningTime SeriesTime Series Analysis+2On the Usage of Generative Models for Network Anomaly Detection in Multivariate Time-Series
Despite the many attempts and approaches for anomaly detection explored over the years, the automatic detection of rare events in data communication networks remains a complex problem. In this paper we introduce Net-GAN,…
Anomaly DetectionIntrusion DetectionTime SeriesTime Series AnalysisA Causal Approach to Detecting Multivariate Time-series Anomalies and Root Causes
Detecting anomalies and the corresponding root causes in multivariate time series plays an important role in monitoring the behaviors of various real-world systems, e.g., IT system operations or manufacturing industry. P…
Anomaly DetectionTime SeriesTime Series AnalysisTime Series Anomaly DetectionHIFI: Anomaly Detection for Multivariate Time Series with High-order Feature Interactions
Monitoring complex systems results in massive multivariate time series data, and anomaly detection of these data is very important to maintain the normal operation of the systems. Despite the recent emergence of a large …
Anomaly DetectionTime SeriesTime Series AnalysisGenAD: General Representations of Multivariate Time Series for Anomaly Detection
Anomaly Detection(AD) for multivariate time series is an active area in machine learning, with critical applications in Information Technology system management, Spacecraft Health monitoring, Multi-Robot Systems detectio…
Anomaly DetectionManagementTime SeriesTime Series Analysis+1