An Ensemble Approach toward Automated Variable Selection for Network Anomaly Detection
While variable selection is essential to optimize the learning complexity by prioritizing features, automating the selection process is preferred since it requires laborious efforts with intensive analysis otherwise. However, it is not an easy task to enable the automation due to several reasons. First, selection techniques often need a condition to terminate the reduction process, for example, by using a threshold or the number of features to stop, and searching an adequate stopping condition is highly challenging. Second, it is uncertain that the reduced variable set would work well; our preliminary experimental result shows that well-known selection techniques produce different sets of variables as a result of reduction (even with the same termination condition), and it is hard to estimate which of them would work the best in future testing. In this paper, we demonstrate the potential power of our approach to the automation of selection process that incorporates well-known selection methods identifying important variables. Our experimental results with two public network traffic data (UNSW-NB15 and IDS2017) show that our proposed method identifies a small number of core variables, with which it is possible to approximate the performance to the one with the entire variables.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionVariable SelectionSimilar Papers 제목 키워드 기반
Unsupervised Anomaly Detection Ensembles using Item Response Theory
Constructing an ensemble from a heterogeneous set of unsupervised anomaly detection methods is challenging because the class labels or the ground truth is unknown. Thus, traditional ensemble techniques that use the respo…
Anomaly DetectionUnsupervised Anomaly DetectionEnsemble Grammar Induction For Detecting Anomalies in Time Series
Time series anomaly detection is an important task, with applications in a broad variety of domains. Many approaches have been proposed in recent years, but often they require that the length of the anomalies be known in…
Anomaly DetectionEnsemble LearningTime SeriesTime Series Analysis+1Anomaly Detection using Ensemble Classification and Evidence Theory
Multi-class ensemble classification remains a popular focus of investigation within the research community. The popularization of cloud services has sped up their adoption due to the ease of deploying large-scale machine…
Anomaly DetectionClassificationMulti-class ClassificationUncertainty QuantificationLearning Ensembles of Anomaly Detectors on Synthetic Data
The main aim of this work is to develop and implement an automatic anomaly detection algorithm for meteorological time-series. To achieve this goal we develop an approach to constructing an ensemble of anomaly detectors …
Anomaly DetectionTime SeriesTime Series AnalysisEnsemble neuroevolution based approach for multivariate time series anomaly detection
Multivariate time series anomaly detection is a very common problem in the field of failure prevention. Fast prevention means lower repair costs and losses. The amount of sensors in novel industry systems makes the anoma…
Anomaly DetectionDeep LearningTime SeriesTime Series Analysis+1