A method to benchmark high-dimensional process drift detection
Process curves are multivariate finite time series data coming from manufacturing processes. This paper studies machine learning that detect drifts in process curve datasets. A theoretic framework to synthetically generate process curves in a controlled way is introduced in order to benchmark machine learning algorithms for process drift detection. An evaluation score, called the temporal area under the curve, is introduced, which allows to quantify how well machine learning models unveil curves belonging to drift segments. Finally, a benchmark study comparing popular machine learning approaches on synthetic data generated with the introduced framework is presented that shows that existing algorithms often struggle with datasets containing multiple drift segments.
Code (1)
Tasks
Drift DetectionTime SeriesSimilar Papers 제목 키워드 기반
Towards non-parametric drift detection via Dynamic Adapting Window Independence Drift Detection (DAWIDD)
The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time; as a consequence machine learning models may become inaccurate and need adjustment. Ma…
Drift DetectionTask-Sensitive Concept Drift Detector with Constraint Embedding
Detecting drifts in data is essential for machine learning applications, as changes in the statistics of processed data typically has a profound influence on the performance of trained models. Most of the available drift…
Drift DetectionMetric LearningDetecting covariate drift in text data using document embeddings and dimensionality reduction
Detecting covariate drift in text data is essential for maintaining the reliability and performance of text analysis models. In this research, we investigate the effectiveness of different document embeddings, dimensiona…
ClassificationDimensionality ReductionDrift DetectionConcept Drift Detection in Federated Networked Systems
As next-generation networks materialize, increasing levels of intelligence are required. Federated Learning has been identified as a key enabling technology of intelligent and distributed networks; however, it is prone t…
Dimensionality ReductionDrift DetectionFederated LearningA Conformance Checking-based Approach for Drift Detection in Business Processes
Real life business processes change over time, in both planned and unexpected ways. The detection of these changes is crucial for organizations to ensure that the expected and the real behavior are as similar as possible…
BenchmarkingDrift Detection