Smart Meter Data Anomaly Detection using Variational Recurrent Autoencoders with Attention
In the digitization of energy systems, sensors and smart meters are increasingly being used to monitor production, operation and demand. Detection of anomalies based on smart meter data is crucial to identify potential risks and unusual events at an early stage, which can serve as a reference for timely initiation of appropriate actions and improving management. However, smart meter data from energy systems often lack labels and contain noise and various patterns without distinctively cyclical. Meanwhile, the vague definition of anomalies in different energy scenarios and highly complex temporal correlations pose a great challenge for anomaly detection. Many traditional unsupervised anomaly detection algorithms such as cluster-based or distance-based models are not robust to noise and not fully exploit the temporal dependency in a time series as well as other dependencies amongst multiple variables (sensors). This paper proposes an unsupervised anomaly detection method based on a Variational Recurrent Autoencoder with attention mechanism. with "dirty" data from smart meters, our method pre-detects missing values and global anomalies to shrink their contribution while training. This paper makes a quantitative comparison with the VAE-based baseline approach and four other unsupervised learning methods, demonstrating its effectiveness and superiority. This paper further validates the proposed method by a real case study of detecting the anomalies of water supply temperature from an industrial heating plant.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionManagementMissing ValuesTime Series AnalysisUnsupervised Anomaly DetectionSimilar Papers 제목 키워드 기반
Unsupervised Anomaly Detection in Energy Time Series Data Using Variational Recurrent Autoencoders with Attention
In the age of big data, time series are being generated in massive amounts. In the energy field, smart grids are enabling a unprecedented data acquisition with the integration of sensors and smart devices. In the context…
Anomaly DetectionDeep AttentionRepresentation LearningTime Series+2Anomaly Detection of Smart Metering System for Power Management with Battery Storage System/Electric Vehicle
A novel smart metering technique capable of anomaly detection was proposed for real-time home power management system. Smart meter data generated in real-time was obtained from 900 households of single apartments. To det…
Anomaly DetectionManagementMissing ValuesSmart Metering System Capable of Anomaly Detection by Bi-directional LSTM Autoencoder
Anomaly detection is concerned with a wide range of applications such as fault detection, system monitoring, and event detection. Identifying anomalies from metering data obtained from smart metering system is a critical…
Anomaly DetectionEvent DetectionFault DetectionUnsupervised Representation Learning and Anomaly Detection in ECG Sequences
While the big data revolution takes place, large amounts of electronic health records, such as electrocardiograms (ECGs) and vital signs data, have become available. These signals are often recorded as time series of obs…
Anomaly DetectionClusteringRepresentation LearningTime Series+2Time and Frequency Domain-based Anomaly Detection in Smart Meter Data for Distribution Network Studies
The widespread integration of new technologies in low-voltage distribution networks on the consumer side creates the need for distribution system operators to perform advanced real-time calculations to estimate network c…
Anomaly Detection