A Sequential Concept Drift Detection Method for On-Device Learning on Low-End Edge Devices
A practical issue of edge AI systems is that data distributions of trained dataset and deployed environment may differ due to noise and environmental changes over time. Such a phenomenon is known as a concept drift, and this gap degrades the performance of edge AI systems and may introduce system failures. To address this gap, retraining of neural network models triggered by concept drift detection is a practical approach. However, since available compute resources are strictly limited in edge devices, in this paper we propose a fully sequential concept drift detection method in cooperation with an on-device sequential learning technique of neural networks. In this case, both the neural network retraining and the proposed concept drift detection are done only by sequential computation to reduce computation cost and memory utilization. Evaluation results of the proposed approach shows that while the accuracy is decreased by 3.8%-4.3% compared to existing batch-based detection methods, it decreases the memory size by 88.9%-96.4% and the execution time by 1.3%-83.8%. As a result, the combination of the neural network retraining and the proposed concept drift detection method is demonstrated on Raspberry Pi Pico that has 264kB memory.
Code (0)
등록된 구현이 없습니다.
Tasks
Drift DetectionPICOSimilar Papers 제목 키워드 기반
A Neural Network-Based On-device Learning Anomaly Detector for Edge Devices
Semi-supervised anomaly detection is an approach to identify anomalies by learning the distribution of normal data. Backpropagation neural networks (i.e., BP-NNs) based approaches have recently drawn attention because of…
Anomaly DetectionCPUSemi-supervised Anomaly DetectionSupervised Anomaly Detection+1An On-Device Federated Learning Approach for Cooperative Model Update between Edge Devices
Most edge AI focuses on prediction tasks on resource-limited edge devices while the training is done at server machines. However, retraining or customizing a model is required at edge devices as the model is becoming out…
Anomaly DetectionFederated LearningAsynchronous Federated Learning for Sensor Data with Concept Drift
Federated learning (FL) involves multiple distributed devices jointly training a shared model without any of the participants having to reveal their local data to a centralized server. Most of previous FL approaches assu…
Drift DetectionEnsemble LearningFederated LearningAn Attention-based Feature Memory Design for Energy-Efficient Continual Learning
Tabular data streams are increasingly prevalent in real-time decision-making across healthcare, finance, and the Internet of Things, often generated and processed on resource-constrained edge and mobile devices. Continua…
Continual LearningCost-Aware Fine-Grained Recognition for IoTs Based on Sequential Fixations
We consider the problem of fine-grained classification on an edge camera device that has limited power. The edge device must sparingly interact with the cloud to minimize communication bits to conserve power, and the clo…
ClassificationDecision MakingDeep Reinforcement LearningFoveation+2