Statistics and Deep Learning-based Hybrid Model for Interpretable Anomaly Detection
Hybrid methods have been shown to outperform pure statistical and pure deep learning methods at both forecasting tasks, and at quantifying the uncertainty associated with those forecasts (prediction intervals). One example is Multivariate Exponential Smoothing Long Short-Term Memory (MES-LSTM), a hybrid between a multivariate statistical forecasting model and a Recurrent Neural Network variant, Long Short-Term Memory. It has also been shown that a model that ($i$) produces accurate forecasts and ($ii$) is able to quantify the associated predictive uncertainty satisfactorily, can be successfully adapted to a model suitable for anomaly detection tasks. With the increasing ubiquity of multivariate data and new application domains, there have been numerous anomaly detection methods proposed in recent years. The proposed methods have largely focused on deep learning techniques, which are prone to suffer from challenges such as ($i$) large sets of parameters that may be computationally intensive to tune, $(ii)$ returning too many false positives rendering the techniques impractical for use, $(iii)$ requiring labeled datasets for training which are often not prevalent in real life, and ($iv$) understanding of the root causes of anomaly occurrences inhibited by the predominantly black-box nature of deep learning methods. In this article, an extension of MES-LSTM is presented, an interpretable anomaly detection model that overcomes these challenges. With a focus on renewable energy generation as an application domain, the proposed approach is benchmarked against the state-of-the-art. The findings are that MES-LSTM anomaly detector is at least competitive to the benchmarks at anomaly detection tasks, and less prone to learning from spurious effects than the benchmarks, thus making it more reliable at root cause discovery and explanation.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionDeep LearningPrediction IntervalsSimilar Papers 제목 키워드 기반
STRIC: Stacked Residuals of Interpretable Components for Time Series Anomaly Detection
We present a residual-style architecture for interpretable forecasting and anomaly detection in multivariate time series. Our architecture is composed of stacked residual blocks designed to separate components of the si…
Anomaly DetectionArticlesTime SeriesTime Series Analysis+1LSTM-Autoencoder based Anomaly Detection for Indoor Air Quality Time Series Data
Anomaly detection for indoor air quality (IAQ) data has become an important area of research as the quality of air is closely related to human health and well-being. However, traditional statistics and shallow machine le…
Anomaly DetectionTime SeriesTime Series AnalysisA Real-time Anomaly Detection Using Convolutional Autoencoder with Dynamic Threshold
The majority of modern consumer-level energy is generated by real-time smart metering systems. These frequently contain anomalies, which prevent reliable estimates of the series' evolution. This work introduces a hybrid …
Anomaly DetectionEnhanced Federated Anomaly Detection Through Autoencoders Using Summary Statistics-Based Thresholding
In Federated Learning (FL), anomaly detection (AD) is a challenging task due to the decentralized nature of data and the presence of non-IID data distributions. This study introduces a novel federated threshold calculati…
Anomaly DetectionFederated LearningFraud DetectionGAN Augmented Text Anomaly Detection with Sequences of Deep Statistics
Anomaly detection is the process of finding data points that deviate from a baseline. In a real-life setting, anomalies are usually unknown or extremely rare. Moreover, the detection must be accomplished in a timely mann…
Anomaly DetectionUnsupervised Anomaly Detection