paper-with-me

Papers

A Semi-Supervised Approach for Abnormal Event Prediction on Large Operational Network Time-Series Data

2021-10-14 · Yijun Lin, Yao-Yi Chiang

Large network logs, recording multivariate time series generated from heterogeneous devices and sensors in a network, can often reveal important information about abnormal activities, such as network intrusions and device malfunctions. Existing machine learning methods for anomaly detection on multivariate time series typically assume that 1) normal sequences would have consistent behavior for training unsupervised models, or 2) require a large set of labeled normal and abnormal sequences for supervised models. However, in practice, normal network activities can demonstrate significantly varying sequence patterns (e.g., before and after rerouting partial network traffic). Also, the recorded abnormal events can be sparse. This paper presents a novel semi-supervised method that efficiently captures dependencies between network time series and across time points to generate meaningful representations of network activities for predicting abnormal events. The method can use the limited labeled data to explicitly learn separable embedding space for normal and abnormal samples and effectively leverage unlabeled data to handle training data scarcity. The experiments demonstrate that our approach significantly outperformed state-of-the-art approaches for event detection on a large real-world network log.

📄 PDF Abstract BibTeX arXiv:2110.07660

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionEvent DetectionTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

Data-Driven Semi-Supervised Machine Learning with Safety Indicators for Abnormal Driving Behavior Detection

2023-12-07 · Yongqi Dong, Lanxin Zhang, Haneen Farah, Arkady Zgonnikov 외

Detecting abnormal driving behavior is critical for road traffic safety and the evaluation of drivers' behavior. With the advancement of machine learning (ML) algorithms and the accumulation of naturalistic driving data,…

Anomaly Detection

A method for incremental discovery of financial event types based on anomaly detection

2023-02-16 · Dianyue Gu, Zixu Li, Zhenhai Guan, Rui Zhang 외

Event datasets in the financial domain are often constructed based on actual application scenarios, and their event types are weakly reusable due to scenario constraints; at the same time, the massive and diverse new fin…

Anomaly DetectionDeep ClusteringKeyword Extraction

You've Got Two Teachers: Co-evolutionary Image and Report Distillation for Semi-supervised Anatomical Abnormality Detection in Chest X-ray

2023-07-18 · Jinghan Sun, Dong Wei, Zhe Xu, Donghuan Lu 외

Chest X-ray (CXR) anatomical abnormality detection aims at localizing and characterising cardiopulmonary radiological findings in the radiographs, which can expedite clinical workflow and reduce observational oversights.…

Anomaly DetectionPseudo Label

Semi-Supervised Deep Learning for Abnormality Classification in Retinal Images

2018-12-19 · Bruno Lecouat, Ken Chang, Chuan-Sheng Foo, Balagopal Unnikrishnan 외

Supervised deep learning algorithms have enabled significant performance gains in medical image classification tasks. But these methods rely on large labeled datasets that require resource-intensive expert annotation. Se…

Deep LearningGeneral ClassificationGenerative Adversarial Networkimage-classification+2

A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipation

2023-05-23 · CVPR 2023 1 · Congqi Cao, Yue Lu, Peng Wang, Yanning Zhang

Semi-supervised video anomaly detection (VAD) is a critical task in the intelligent surveillance system. However, an essential type of anomaly in VAD named scene-dependent anomaly has not received the attention of resear…

Anomaly DetectionVideo Anomaly Detection