A Bayesian Approach to Concept Drift
To cope with concept drift, we placed a probability distribution over the location of the most-recent drift point. We used Bayesian model comparison to update this distribution from the predictions of models trained on blocks of consecutive observations and pruned potential drift points with low probability. We compare our approach to a non-probabilistic method for drift and a probabilistic method for change-point detection. In our experiments, our approach generally yielded improved accuracy and/or speed over these other methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Change Point DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Dirichlet process mixture models for non-stationary data streams
In recent years, we have seen a handful of work on inference algorithms over non-stationary data streams. Given their flexibility, Bayesian non-parametric models are a good candidate for these scenarios. However, reliabl…
ClusteringDensity EstimationVariational InferenceInvestigating the Robustness of Knowledge Tracing Models in the Presence of Student Concept Drift
Knowledge Tracing (KT) has been an established problem in the educational data mining field for decades, and it is commonly assumed that the underlying learning process being modeled remains static. Given the ever-changi…
Knowledge TracingAdaptation Strategies for Automated Machine Learning on Evolving Data
Automated Machine Learning (AutoML) systems have been shown to efficiently build good models for new datasets. However, it is often not clear how well they can adapt when the data evolves over time. The main goal of this…
AutoMLBayesian OptimizationBIG-bench Machine LearningA Probabilistic Framework for Adapting to Changing and Recurring Concepts in Data Streams
The distribution of streaming data often changes over time as conditions change, a phenomenon known as concept drift. Only a subset of previous experience, collected in similar conditions, is relevant to learning an accu…
Detecting and Adapting to Irregular Distribution Shifts in Bayesian Online Learning
We consider the problem of online learning in the presence of distribution shifts that occur at an unknown rate and of unknown intensity. We derive a new Bayesian online inference approach to simultaneously infer these d…
Autonomous NavigationChange Point Detection