Concept Drift Detection and Adaptation with Hierarchical Hypothesis Testing
A fundamental issue for statistical classification models in a streaming environment is that the joint distribution between predictor and response variables changes over time (a phenomenon also known as concept drifts), such that their classification performance deteriorates dramatically. In this paper, we first present a hierarchical hypothesis testing (HHT) framework that can detect and also adapt to various concept drift types (e.g., recurrent or irregular, gradual or abrupt), even in the presence of imbalanced data labels. A novel concept drift detector, namely Hierarchical Linear Four Rates (HLFR), is implemented under the HHT framework thereafter. By substituting a widely-acknowledged retraining scheme with an adaptive training strategy, we further demonstrate that the concept drift adaptation capability of HLFR can be significantly boosted. The theoretical analysis on the Type-I and Type-II errors of HLFR is also performed. Experiments on both simulated and real-world datasets illustrate that our methods outperform state-of-the-art methods in terms of detection precision, detection delay as well as the adaptability across different concept drift types.
Code (0)
등록된 구현이 없습니다.
Tasks
Drift DetectionGeneral ClassificationTwo-sample testingSimilar Papers 제목 키워드 기반
Request-and-Reverify: Hierarchical Hypothesis Testing for Concept Drift Detection with Expensive Labels
One important assumption underlying common classification models is the stationarity of the data. However, in real-world streaming applications, the data concept indicated by the joint distribution of feature and label i…
AttributeDrift DetectionGeneral ClassificationTwo-sample testingFederated Learning under Distributed Concept Drift
Federated Learning (FL) under distributed concept drift is a largely unexplored area. Although concept drift is itself a well-studied phenomenon, it poses particular challenges for FL, because drifts arise staggered in t…
ClusteringDrift DetectionFederated LearningConcept Drift Detection via Equal Intensity k-means Space Partitioning
Data stream poses additional challenges to statistical classification tasks because distributions of the training and target samples may differ as time passes. Such distribution change in streaming data is called concept…
Change DetectionDrift DetectionSensitivityMORPH: Towards Automated Concept Drift Adaptation for Malware Detection
Concept drift is a significant challenge for malware detection, as the performance of trained machine learning models degrades over time, rendering them impractical. While prior research in malware concept drift adaptati…
Active LearningMalware DetectionMORPHPseudo LabelMETER: A Dynamic Concept Adaptation Framework for Online Anomaly Detection
Real-time analytics and decision-making require online anomaly detection (OAD) to handle drifts in data streams efficiently and effectively. Unfortunately, existing approaches are often constrained by their limited detec…
Anomaly DetectionDecision MakingDrift Detection