Machine Learning for Real-Time Anomaly Detection in Optical Networks
This work proposes a real-time anomaly detection scheme that leverages the multi-step ahead prediction capabilities of encoder-decoder (ED) deep learning models with recurrent units. Specifically, an encoder-decoder is used to model soft-failure evolution over a long future horizon (i.e., for several days ahead) by analyzing past quality-of-transmission (QoT) observations. This information is subsequently used for real-time anomaly detection (e.g., of attack incidents), as the knowledge of how the QoT is expected to evolve allows capturing unexpected network behavior. Specifically, for anomaly detection, a statistical hypothesis testing scheme is used, alleviating the limitations of supervised (SL) and unsupervised learning (UL) schemes, usually applied for this purpose. Indicatively, the proposed scheme eliminates the need for labeled anomalies, required when SL is applied, and the need for on-line analyzing entire datasets to identify abnormal instances (i.e., UL). Overall, it is shown that by utilizing QoT evolution information, the proposed approach can effectively detect abnormal deviations in real-time. Importantly, it is shown that the information concerning soft-failure evolution (i.e., QoT predictions) is essential to accurately detect anomalies.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionDecoderSimilar Papers 제목 키워드 기반
Machine Learning-based Anomaly Detection in Optical Fiber Monitoring
Secure and reliable data communication in optical networks is critical for high-speed Internet. However, optical fibers, serving as the data transmission medium providing connectivity to billons of users worldwide, are p…
Anomaly DetectionBIG-bench Machine LearningFault DetectionFault DiagnosisML-based Anomaly Detection in Optical Fiber Monitoring
Secure and reliable data communication in optical networks is critical for high-speed internet. We propose a data driven approach for the anomaly detection and faults identification in optical networks to diagnose physic…
Anomaly DetectionFast reconstruction-based ROI triggering via anomaly detection in the CYGNO optical TPC
Optical-readout Time Projection Chambers (TPCs) produce megapixel-scale images whose fine-grained topological information is essential for rare-event searches, but whose size challenges real-time data selection. We prese…
Anomaly DetectionReal-Time Anomaly Detection With HMOF Feature
Anomaly detection is a challenging problem in intelligent video surveillance. Most existing methods are computation consuming, which cannot satisfy the real-time requirement. In this paper, we propose a real-time anomaly…
Anomaly DetectionClusteringOptical Flow EstimationA Unified Siamese Learning Framework for Zero-Day Anomaly Detection and Classification in Optical Networks
A multi-similarity Siamese neural network unifies zero-day anomaly detection and one-shot classification in optical networks, achieving over 99% accuracy and instant adaptability across lightpaths and unseen anomaly type…
Anomaly Detection