Ensuring Learning Guarantees on Concept Drift Detection with Statistical Learning Theory
Concept Drift (CD) detection intends to continuously identify changes in data stream behaviors, supporting researchers in the study and modeling of real-world phenomena. Motivated by the lack of learning guarantees in current CD algorithms, we decided to take advantage of the Statistical Learning Theory (SLT) to formalize the necessary requirements to ensure probabilistic learning bounds, so drifts would refer to actual changes in data rather than by chance. As discussed along this paper, a set of mathematical assumptions must be held in order to rely on SLT bounds, which are especially controversial in CD scenarios. Based on this issue, we propose a methodology to address those assumptions in CD scenarios and therefore ensure learning guarantees. Complementary, we assessed a set of relevant and known CD algorithms from the literature in light of our methodology. As main contribution, we expect this work to support researchers while designing and evaluating CD algorithms on different domains.
Code (0)
등록된 구현이 없습니다.
Tasks
Drift DetectionLearning TheorySimilar Papers 제목 키워드 기반
Flexible and Efficient Drift Detection without Labels
Machine learning models are being increasingly used to automate decisions in almost every domain, and ensuring the performance of these models is crucial for ensuring high quality machine learning enabled services. Ensur…
Drift DetectionDetecting Concept Drift in Neural Networks Using Chi-squared Goodness of Fit Testing
As the adoption of deep learning models has grown beyond human capacity for verification, meta-algorithms are needed to ensure reliable model inference. Concept drift detection is a field dedicated to identifying statist…
Drift DetectionRCCDA: Adaptive Model Updates in the Presence of Concept Drift under a Constrained Resource Budget
Machine learning (ML) algorithms deployed in real-world environments are often faced with the challenge of adapting models to concept drift, where the task data distributions are shifting over time. The problem becomes e…
Domain GeneralizationDrift DetectionOnline Drift Detection with Maximum Concept Discrepancy
Continuous learning from an immense volume of data streams becomes exceptionally critical in the internet era. However, data streams often do not conform to the same distribution over time, leading to a phenomenon called…
Contrastive LearningDrift DetectionLyapunov-Stable Adaptive Control for Multimodal Concept Drift
Multimodal learning systems often struggle in non-stationary environments due to concept drift, where changing data distributions can degrade performance. Modality-specific drifts and the lack of mechanisms for continuou…