paper-with-me

홈 › Papers

Automatic Learning to Detect Concept Drift

2021-05-04 · Hang Yu, Tianyu Liu, Jie Lu, Guangquan Zhang

Many methods have been proposed to detect concept drift, i.e., the change in the distribution of streaming data, due to concept drift causes a decrease in the prediction accuracy of algorithms. However, the most of current detection methods are based on the assessment of the degree of change in the data distribution, cannot identify the type of concept drift. In this paper, we propose Active Drift Detection with Meta learning (Meta-ADD), a novel framework that learns to classify concept drift by tracking the changed pattern of error rates. Specifically, in the training phase, we extract meta-features based on the error rates of various concept drift, after which a meta-detector is developed via a prototypical neural network by representing various concept drift classes as corresponding prototypes. In the detection phase, the learned meta-detector is fine-tuned to adapt to the corresponding data stream via stream-based active learning. Hence, Meta-ADD uses machine learning to learn to detect concept drifts and identify their types automatically, which can directly support drift understand. The experiment results verify the effectiveness of Meta-ADD.

📄 PDF Abstract BibTeX arXiv:2105.01419

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningDrift DetectionMeta-Learning

Similar Papers 제목 키워드 기반

Automating concept-drift detection by self-evaluating predictive model degradation

2019-07-18 · Tania Cerquitelli, Stefano Proto, Francesco Ventura, Daniele Apiletti 외

A key aspect of automating predictive machine learning entails the capability of properly triggering the update of the trained model. To this aim, suitable automatic solutions to self-assess the prediction quality and th…

BIG-bench Machine LearningDrift Detection

Automatic Model Monitoring for Data Streams

2019-08-12 · Fábio Pinto, Marco O. P. Sampaio, Pedro Bizarro

Detecting concept drift is a well known problem that affects production systems. However, two important issues that are frequently not addressed in the literature are 1) the detection of drift when the labels are not imm…

Fraud Detectionmodel

Expert-Driven Monitoring of Operational ML Models

2024-01-22 · Joran Leest, Claudia Raibulet, Ilias Gerostathopoulos, Patricia Lago

We propose Expert Monitoring, an approach that leverages domain expertise to enhance the detection and mitigation of concept drift in machine learning (ML) models. Our approach supports practitioners by consolidating dom…

Are Concept Drift Detectors Reliable Alarming Systems? -- A Comparative Study

2022-11-23 · Lorena Poenaru-Olaru, Luis Cruz, Arie van Deursen, Jan S. Rellermeyer

As machine learning models increasingly replace traditional business logic in the production system, their lifecycle management is becoming a significant concern. Once deployed into production, the machine learning model…

Drift DetectionManagement

Learning Unbiased Cluster Descriptors for Interpretable Imbalanced Concept Drift Detection

2026-03-06 · Yiqun Zhang, Zhanpei Huang, Mingjie Zhao, Chuyao Zhang 외 arxiv

Unlabeled streaming data are usually collected to describe dynamic systems, where concept drift detection is a vital prerequisite to understanding the evolution of systems. However, the drifting concepts are usually imba…