A Semi-Supervised Approach for Abnormal Event Prediction on Large Operational Network Time-Series Data
Large network logs, recording multivariate time series generated from heterogeneous devices and sensors in a network, can often reveal important information about abnormal activities, such as network intrusions and device malfunctions. Existing machine learning methods for anomaly detection on multivariate time series typically assume that 1) normal sequences would have consistent behavior for training unsupervised models, or 2) require a large set of labeled normal and abnormal sequences for supervised models. However, in practice, normal network activities can demonstrate significantly varying sequence patterns (e.g., before and after rerouting partial network traffic). Also, the recorded abnormal events can be sparse. This paper presents a novel semi-supervised method that efficiently captures dependencies between network time series and across time points to generate meaningful representations of network activities for predicting abnormal events. The method can use the limited labeled data to explicitly learn separable embedding space for normal and abnormal samples and effectively leverage unlabeled data to handle training data scarcity. The experiments demonstrate that our approach significantly outperformed state-of-the-art approaches for event detection on a large real-world network log.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionEvent DetectionTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Data-Driven Semi-Supervised Machine Learning with Safety Indicators for Abnormal Driving Behavior Detection
Detecting abnormal driving behavior is critical for road traffic safety and the evaluation of drivers' behavior. With the advancement of machine learning (ML) algorithms and the accumulation of naturalistic driving data,…
Anomaly DetectionA method for incremental discovery of financial event types based on anomaly detection
Event datasets in the financial domain are often constructed based on actual application scenarios, and their event types are weakly reusable due to scenario constraints; at the same time, the massive and diverse new fin…
Anomaly DetectionDeep ClusteringKeyword ExtractionYou've Got Two Teachers: Co-evolutionary Image and Report Distillation for Semi-supervised Anatomical Abnormality Detection in Chest X-ray
Chest X-ray (CXR) anatomical abnormality detection aims at localizing and characterising cardiopulmonary radiological findings in the radiographs, which can expedite clinical workflow and reduce observational oversights.…
Anomaly DetectionPseudo LabelSemi-Supervised Deep Learning for Abnormality Classification in Retinal Images
Supervised deep learning algorithms have enabled significant performance gains in medical image classification tasks. But these methods rely on large labeled datasets that require resource-intensive expert annotation. Se…
Deep LearningGeneral ClassificationGenerative Adversarial Networkimage-classification+2A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipation
Semi-supervised video anomaly detection (VAD) is a critical task in the intelligent surveillance system. However, an essential type of anomaly in VAD named scene-dependent anomaly has not received the attention of resear…
Anomaly DetectionVideo Anomaly Detection