Label-Free Concept Drift Assessment for Reliable AI in Emerging Wireless Applications
Machine learning models deployed in non-stationary environments degrade silently, since as the input distribution drifts their accuracy decays without an error signal and without labels to reveal it. Sustaining reliable AI therefore requires a concept-drift detector that acts as an external observer of the deployed model, monitoring it using unlabeled operational data alone, so that an MLOps actuator triggers retraining and redeployment only when it is warranted. This paper contributes two concept drift detectors, namely Confidence-Filtered Pseudo-Label Transfer (CFPT) and TabAutoDrift, which combine representation learning with statistical testing to compute an expected utility score that signals whether a deployed model should be retrained, without requiring ground-truth labels after deployment. The detectors are evaluated on two emerging, label-scarce wireless application domains in which post deployment ground truth is effectively unavailable, namely outdoor fingerprinting-based localization and link-anomaly detection. They outperform the classical detectors ADWIN, DDM, and CUSUM, attaining a drift-detection F1-score between 0.88 and 0.94 in the fingerprinting use case and between 0.80 and 1.00 in the link-anomaly use case, up to 0.24 higher than the strongest classical detector. Interpreted as reliability decisions, this precision indicates that the proposed detectors signal retraining more dependably.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionSimilar Papers 제목 키워드 기반
Online Drift Detection with Maximum Concept Discrepancy
Continuous learning from an immense volume of data streams becomes exceptionally critical in the internet era. However, data streams often do not conform to the same distribution over time, leading to a phenomenon called…
Contrastive LearningDrift DetectionTime to Retrain? Detecting Concept Drifts in Machine Learning Systems
With the boom of machine learning (ML) techniques, software practitioners build ML systems to process the massive volume of streaming data for diverse software engineering tasks such as failure prediction in AIOps. Train…
On the Reliable Detection of Concept Drift from Streaming Unlabeled Data
Classifiers deployed in the real world operate in a dynamic environment, where the data distribution can change over time. These changes, referred to as concept drift, can cause the predictive performance of the classifi…
Change DetectionDrift DetectionHandling Adversarial Concept Drift in Streaming Data
Classifiers operating in a dynamic, real world environment, are vulnerable to adversarial activity, which causes the data distribution to change over time. These changes are traditionally referred to as concept drift, an…
Active LearningDrift DetectionTaming SAM3 in the Wild: A Concept Bank for Open-Vocabulary Segmentation
The recent introduction of \texttt{SAM3} has revolutionized Open-Vocabulary Segmentation (OVS) through \textit{promptable concept segmentation}, which grounds pixel predictions in flexible concept prompts. However, this …