Research on Dynamic Data Flow Anomaly Detection based on Machine Learning
The sophistication and diversity of contemporary cyberattacks have rendered the use of proxies, gateways, firewalls, and encrypted tunnels as a standalone defensive strategy inadequate. Consequently, the proactive identification of data anomalies has emerged as a prominent area of research within the field of data security. The majority of extant studies concentrate on sample equilibrium data, with the consequence that the detection effect is not optimal in the context of unbalanced data. In this study, the unsupervised learning method is employed to identify anomalies in dynamic data flows. Initially, multi-dimensional features are extracted from real-time data, and a clustering algorithm is utilised to analyse the patterns of the data. This enables the potential outliers to be automatically identified. By clustering similar data, the model is able to detect data behaviour that deviates significantly from normal traffic without the need for labelled data. The results of the experiments demonstrate that the proposed method exhibits high accuracy in the detection of anomalies across a range of scenarios. Notably, it demonstrates robust and adaptable performance, particularly in the context of unbalanced data.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionClusteringDiversitySimilar Papers 제목 키워드 기반
Temporal-Conditioned Normalizing Flows for Multivariate Time Series Anomaly Detection
This paper introduces temporal-conditioned normalizing flows (tcNF), a novel framework that addresses anomaly detection in time series data with accurate modeling of temporal dependencies and uncertainty. By conditioning…
Time Series Anomaly DetectionMSFlow: Multi-Scale Flow-based Framework for Unsupervised Anomaly Detection
Unsupervised anomaly detection (UAD) attracts a lot of research interest and drives widespread applications, where only anomaly-free samples are available for training. Some UAD applications intend to further locate the …
Anomaly DetectionAnomaly LocalizationUnsupervised Anomaly DetectionGNN-based Anomaly Detection for Encoded Network Traffic
The early research report explores the possibility of using Graph Neural Networks (GNNs) for anomaly detection in internet traffic data enriched with information. While recent studies have made significant progress in us…
Anomaly DetectionTime SeriesSelf-Supervised Texture Image Anomaly Detection By Fusing Normalizing Flow and Dictionary Learning
A common study area in anomaly identification is industrial images anomaly detection based on texture background. The interference of texture images and the minuteness of texture anomalies are the main reasons why many e…
Anomaly DetectionDictionary LearningRepresentation LearningAnomaly Detection in Dynamic Graphs: A Comprehensive Survey
This survey paper presents a comprehensive and conceptual overview of anomaly detection using dynamic graphs. We focus on existing graph-based anomaly detection (AD) techniques and their applications to dynamic networks.…
Anomaly DetectionGraph MiningSurvey