Implicit Concept Drift Detection for Multi-label Data Streams
Many real-world applications adopt multi-label data streams as the need for algorithms to deal with rapidly changing data increases. Changes in data distribution, also known as concept drift, cause the existing classification models to rapidly lose their effectiveness. To assist the classifiers, we propose a novel algorithm called Label Dependency Drift Detector (LD3), an implicit (unsupervised) concept drift detector using label dependencies within the data for multi-label data streams. Our study exploits the dynamic temporal dependencies between labels using a label influence ranking method, which leverages a data fusion algorithm and uses the produced ranking to detect concept drift. LD3 is the first unsupervised concept drift detection algorithm in the multi-label classification problem area. In this study, we perform an extensive evaluation of LD3 by comparing it with 14 prevalent supervised concept drift detection algorithms that we adapt to the problem area using 12 datasets and a baseline classifier. The results show that LD3 provides between 19.8\% and 68.6\% better predictive performance than comparable detectors on both real-world and synthetic data streams.
Code (0)
등록된 구현이 없습니다.
Tasks
Drift DetectionMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONSimilar Papers 제목 키워드 기반
Concept Drift Detection using Ensemble of Integrally Private Models
Deep neural networks (DNNs) are one of the most widely used machine learning algorithm. DNNs requires the training data to be available beforehand with true labels. This is not feasible for many real-world problems where…
Drift DetectionAn Efficient Concept Drift Detection Method for Streaming Data under Limited Labeling
In data stream analysis, detecting the concept drift accu- rately is important to maintain the classification performance. Most drift detection methods assume that the class labels become available immedi- ately after…
Drift DetectionDrift detection using uncertainty distribution divergence
Data generated from naturally occurring processes tends to be non-stationary. For example, seasonal and gradual changes in climate data and sudden changes in financial data. In machine learning the degradation in classif…
Drift DetectionOnline Semi-Supervised Concept Drift Detection with Density Estimation
Concept drift is formally defined as the change in joint distribution of a set of input variables X and a target variable y. The two types of drift that are extensively studied are real drift and virtual drift where the …
Density EstimationDrift DetectionAn Adaptive Sampling Framework for Detecting Localized Concept Drift under Label Scarcity
Concept drift and label scarcity are two critical challenges limiting the robustness of predictive models in dynamic industrial environments. Existing drift detection methods often assume global shifts and rely on dense …