Exathlon: A Benchmark for Explainable Anomaly Detection over Time Series
Access to high-quality data repositories and benchmarks have been instrumental in advancing the state of the art in many experimental research domains. While advanced analytics tasks over time series data have been gaining lots of attention, lack of such community resources severely limits scientific progress. In this paper, we present Exathlon, the first comprehensive public benchmark for explainable anomaly detection over high-dimensional time series data. Exathlon has been systematically constructed based on real data traces from repeated executions of large-scale stream processing jobs on an Apache Spark cluster. Some of these executions were intentionally disturbed by introducing instances of six different types of anomalous events (e.g., misbehaving inputs, resource contention, process failures). For each of the anomaly instances, ground truth labels for the root cause interval as well as those for the extended effect interval are provided, supporting the development and evaluation of a wide range of anomaly detection (AD) and explanation discovery (ED) tasks. We demonstrate the practical utility of Exathlon's dataset, evaluation methodology, and end-to-end data science pipeline design through an experimental study with three state-of-the-art AD and ED techniques.
Code (1)
Tasks
Anomaly DetectionTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Unsupervised Anomaly Detection in Multivariate Time Series across Heterogeneous Domains
The widespread adoption of digital services, along with the scale and complexity at which they operate, has made incidents in IT operations increasingly more likely, diverse, and impactful. This has led to the rapid deve…
Anomaly DetectionBenchmarkingDomain GeneralizationTime Series+1Benchmarking Anomaly Detection Across Heterogeneous Cloud Telemetry Datasets
Anomaly detection is important for keeping cloud systems reliable and stable. Deep learning has improved time-series anomaly detection, but most models are evaluated on one dataset at a time. This raises questions about …
Anomaly DetectionInstance-Aligned Captions for Explainable Video Anomaly Detection
Explainable video anomaly detection (VAD) is crucial for safety-critical applications, yet even with recent progress, much of the research still lacks spatial grounding, making the explanations unverifiable. This limitat…
Video Anomaly DetectionA Survey on Explainable Anomaly Detection
In the past two decades, most research on anomaly detection has focused on improving the accuracy of the detection, while largely ignoring the explainability of the corresponding methods and thus leaving the explanation …
Anomaly DetectionSurveyExplainable Unsupervised Anomaly Detection with Random Forest
We describe the use of an unsupervised Random Forest for similarity learning and improved unsupervised anomaly detection. By training a Random Forest to discriminate between real data and synthetic data sampled from a un…
Anomaly DetectionFeature ImportanceUnsupervised Anomaly Detection