Time and Frequency Domain-based Anomaly Detection in Smart Meter Data for Distribution Network Studies
The widespread integration of new technologies in low-voltage distribution networks on the consumer side creates the need for distribution system operators to perform advanced real-time calculations to estimate network conditions. In recent years, data-driven models based on machine learning and big data analysis have emerged for calculation purposes, leveraging the information available in large datasets obtained from smart meters and other advanced measurement infrastructure. However, existing data-driven algorithms do not take into account the quality of data collected from smart meters. They lack built-in anomaly detection mechanisms and fail to differentiate anomalies based on whether the value or context of anomalous data instances deviates from the norm. This paper focuses on methods for detecting and mitigating the impact of anomalies on the consumption of active and reactive power datasets. It proposes an anomaly detection framework based on the Isolation Forest machine learning algorithm and Fast Fourier Transform filtering that works in both the time and frequency domain and is unaffected by point anomalies or contextual anomalies of the power consumption data. The importance of integrating anomaly detection methods is demonstrated in the analysis important for distribution networks with a high share of smart meters.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionSimilar Papers 제목 키워드 기반
F-SE-LSTM: A Time Series Anomaly Detection Method with Frequency Domain Information
With the development of society, time series anomaly detection plays an important role in network and IoT services. However, most existing anomaly detection methods directly analyze time series in the time domain and can…
Anomaly DetectionTime SeriesTime Series Anomaly DetectionTFAD: A Decomposition Time Series Anomaly Detection Architecture with Time-Frequency Analysis
Time series anomaly detection is a challenging problem due to the complex temporal dependencies and the limited label data. Although some algorithms including both traditional and deep models have been proposed, most of …
Anomaly DetectionData AugmentationTime SeriesTime Series Analysis+1Explainable Time Series Anomaly Detection using Masked Latent Generative Modeling
We present a novel time series anomaly detection method that achieves excellent detection accuracy while offering a superior level of explainability. Our proposed method, TimeVQVAE-AD, leverages masked generative modelin…
Anomaly DetectionTime SeriesTime Series Anomaly DetectionTime Series GenerationLearning Multi-Pattern Normalities in the Frequency Domain for Efficient Time Series Anomaly Detection
Anomaly detection significantly enhances the robustness of cloud systems. While neural network-based methods have recently demonstrated strong advantages, they encounter practical challenges in cloud environments: the co…
Anomaly DetectionTime SeriesTime Series Anomaly DetectionLogSHIELD: A Graph-based Real-time Anomaly Detection Framework using Frequency Analysis
Anomaly-based cyber threat detection using deep learning is on a constant growth in popularity for novel cyber-attack detection and forensics. A robust, efficient, and real-time threat detector in a large-scale operation…
Anomaly DetectionCyber Attack DetectionGraph EmbeddingGraph Neural Network