Concept Drift Detection for Streaming Data
Common statistical prediction models often require and assume stationarity in the data. However, in many practical applications, changes in the relationship of the response and predictor variables are regularly observed over time, resulting in the deterioration of the predictive performance of these models. This paper presents Linear Four Rates (LFR), a framework for detecting these concept drifts and subsequently identifying the data points that belong to the new concept (for relearning the model). Unlike conventional concept drift detection approaches, LFR can be applied to both batch and stream data; is not limited by the distribution properties of the response variable (e.g., datasets with imbalanced labels); is independent of the underlying statistical-model; and uses user-specified parameters that are intuitively comprehensible. The performance of LFR is compared to benchmark approaches using both simulated and commonly used public datasets that span the gamut of concept drift types. The results show LFR significantly outperforms benchmark approaches in terms of recall, accuracy and delay in detection of concept drifts across datasets.
Code (1)
Tasks
Drift DetectionSimilar Papers 제목 키워드 기반
Online Semi-Supervised Concept Drift Detection with Density Estimation
Concept drift is formally defined as the change in joint distribution of a set of input variables X and a target variable y. The two types of drift that are extensively studied are real drift and virtual drift where the …
Density EstimationDrift DetectionLearner-based Concept Drift Detection: Analysis and Evaluation
Machine learning algorithms deployed for evolving streaming environments must handle the non-stationary data distributions, commonly referred to as concept drift. The presence of concept drift poses a major challenge for…
An Efficient Concept Drift Detection Method for Streaming Data under Limited Labeling
In data stream analysis, detecting the concept drift accu- rately is important to maintain the classification performance. Most drift detection methods assume that the class labels become available immedi- ately after…
Drift DetectionHandling Adversarial Concept Drift in Streaming Data
Classifiers operating in a dynamic, real world environment, are vulnerable to adversarial activity, which causes the data distribution to change over time. These changes are traditionally referred to as concept drift, an…
Active LearningDrift DetectionDiagnosing Concept Drift with Visual Analytics
Concept drift is a phenomenon in which the distribution of a data stream changes over time in unforeseen ways, causing prediction models built on historical data to become inaccurate. While a variety of automated methods…
Drift Detectiontext-classificationText Classification