Improved histogram-based anomaly detector with the extended principal component features
In this era of big data, databases are growing rapidly in terms of the number of records. Fast automatic detection of anomalous records in these massive databases is a challenging task. Traditional distance based anomaly detectors are not applicable in these massive datasets. Recently, a simple but extremely fast anomaly detector using one-dimensional histograms has been introduced. The anomaly score of a data instance is computed as the product of the probability mass of histograms in each dimensions where it falls into. It is shown to produce competitive results compared to many state-of-the-art methods in many datasets. Because it assumes data features are independent of each other, it results in poor detection accuracy when there is correlation between features. To address this issue, we propose to increase the feature size by adding more features based on principal components. Our results show that using the original input features together with principal components improves the detection accuracy of histogram-based anomaly detector significantly without compromising much in terms of run-time.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
An Improved Discriminative Optimization for 3D Rigid Point Cloud Registration
The Discriminative Optimization (DO) algorithm has been proved much successful in 3D point cloud registration. In the original DO, the feature (descriptor) of two point cloud was defined as a histogram, and the element o…
Point Cloud RegistrationHOPC: Histogram of Oriented Principal Components of 3D Pointclouds for Action Recognition
Existing techniques for 3D action recognition are sensitive to viewpoint variations because they extract features from depth images which change significantly with viewpoint. In contrast, we directly process the pointclo…
3D Action RecognitionAction RecognitionKeypoint DetectionTemporal Action LocalizationDINAMO: Dynamic and INterpretable Anomaly MOnitoring for Large-Scale Particle Physics Experiments
Ensuring reliable data collection in large-scale particle physics experiments demands Data Quality Monitoring (DQM) procedures to detect possible detector malfunctions and preserve data integrity. Traditionally, this res…
Anomaly DetectionAssessing the Impact of a Supervised Classification Filter on Flow-based Hybrid Network Anomaly Detection
Constant evolution and the emergence of new cyberattacks require the development of advanced techniques for defense. This paper aims to measure the impact of a supervised filter (classifier) in network anomaly detection.…
Anomaly DetectionEffectiveness of random deep feature selection for securing image manipulation detectors against adversarial examples
We investigate if the random feature selection approach proposed in [1] to improve the robustness of forensic detectors to targeted attacks, can be extended to detectors based on deep learning features. In particular, we…
feature selectionImage ManipulationImage Manipulation Detection