ASE: Anomaly Scoring Based Ensemble Learning for Imbalanced Datasets
Nowadays, many classification algorithms have been applied to various industries to help them work out their problems met in real-life scenarios. However, in many binary classification tasks, samples in the minority class only make up a small part of all instances, which leads to the datasets we get usually suffer from high imbalance ratio. Existing models sometimes treat minority classes as noise or ignore them as outliers encountering data skewing. In order to solve this problem, we propose a bagging ensemble learning framework $ASE$ (Anomaly Scoring Based Ensemble Learning). This framework has a scoring system based on anomaly detection algorithms which can guide the resampling strategy by divided samples in the majority class into subspaces. Then specific number of instances will be under-sampled from each subspace to construct subsets by combining with the minority class. And we calculate the weights of base classifiers trained by the subsets according to the classification result of the anomaly detection model and the statistics of the subspaces. Experiments have been conducted which show that our ensemble learning model can dramatically improve the performance of base classifiers and is more efficient than other existing methods under a wide range of imbalance ratio, data scale and data dimension. $ASE$ can be combined with various classifiers and every part of our framework has been proved to be reasonable and necessary.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionBinary ClassificationEnsemble LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Ensemble Methods for Sequence Classification with Hidden Markov Models
We present a lightweight approach to sequence classification using Ensemble Methods for Hidden Markov Models (HMMs). HMMs offer significant advantages in scenarios with imbalanced or smaller datasets due to their simplic…
Anomaly DetectionBinary ClassificationIsolation-based Spherical Ensemble Representations for Anomaly Detection
Anomaly detection is a critical task in data mining and management with applications spanning fraud detection, network security, and log monitoring. Despite extensive research, existing unsupervised anomaly detection met…
Unsupervised Anomaly DetectionFraud DetectionClassification of Imbalanced Credit scoring data sets Based on Ensemble Method with the Weighted-Hybrid-Sampling
In the era of big data, the utilization of credit-scoring models to determine the credit risk of applicants accurately becomes a trend in the future. The conventional machine learning on credit scoring data sets tends to…
AERF: Adaptive ensemble random fuzzy algorithm for anomaly detection in cloud computing
The abnormality of system behavior is inevitable in cloud computing because of its complexity and scale. How to perform anomaly detection on the system’s operating data to discover abnormal behavior has become a popula…
Anomaly DetectionBenchmarkingCloud ComputingDiversitySupervised Anomaly Detection via Conditional Generative Adversarial Network and Ensemble Active Learning
Anomaly detection has wide applications in machine intelligence but is still a difficult unsolved problem. Major challenges include the rarity of labeled anomalies and it is a class highly imbalanced problem. Traditional…
Active LearningAnomaly DetectionEnsemble LearningGenerative Adversarial Network+1