Bridging Generalization and Personalization in Human Activity Recognition via On-Device Few-Shot Learning
Human Activity Recognition (HAR) with different sensing modalities requires both strong generalization across diverse users and efficient personalization for individuals. However, conventional HAR models often fail to generalize when faced with user-specific variations, leading to degraded performance. To address this challenge, we propose a novel on-device few-shot learning framework that bridges generalization and personalization in HAR. Our method first trains a generalizable representation across users and then rapidly adapts to new users with only a few labeled samples, updating lightweight classifier layers directly on resource-constrained devices. This approach achieves robust on-device learning with minimal computation and memory cost, making it practical for real-world deployment. We implement our framework on the energy-efficient RISC-V GAP9 microcontroller and evaluate it on three benchmark datasets (RecGym, QVAR-Gesture, Ultrasound-Gesture). Across these scenarios, post-deployment adaptation improves accuracy by 3.73\%, 17.38\%, and 3.70\%, respectively. These results demonstrate that few-shot on-device learning enables scalable, user-aware, and energy-efficient wearable human activity recognition by seamlessly uniting generalization and personalization. The related framework is open sourced for further research\footnote{https://github.com/kangpx/onlineTiny2023}.
Code (0)
등록된 구현이 없습니다.
Tasks
Human Activity RecognitionFew-Shot LearningSimilar Papers 제목 키워드 기반
MAGNETO: Edge AI for Human Activity Recognition -- Privacy and Personalization
Human activity recognition (HAR) is a well-established field, significantly advanced by modern machine learning (ML) techniques. While companies have successfully integrated HAR into consumer products, they typically rel…
Activity RecognitionHuman Activity RecognitionIncremental LearningDGAR: A Unified Domain Generalization Framework for RF-Enabled Human Activity Recognition
Radio-frequency (RF)-based human activity recognition (HAR) provides a contactless and privacy-preserving solution for monitoring human behavior in applications such as personalized healthcare, ambient assisted living, a…
Activity RecognitionDomain GeneralizationHuman Activity RecognitionPrivacy PreservingOn Handling Catastrophic Forgetting for Incremental Learning of Human Physical Activity on the Edge
Human activity recognition (HAR) has been a classic research problem. In particular, with recent machine learning (ML) techniques, the recognition task has been largely investigated by companies and integrated into their…
Activity RecognitionHuman Activity RecognitionIncremental LearningFedAvg for HAR: Exploring the Tradeoff Between Personalized and Generalization Accuracy
The federated learning (FL) paradigm fosters distributed pervasive computing combined with artificial intelligence techniques, allowing for optimized data usage and improved mitigation of privacy concerns. Indeed, model …
Human Activity RecognitionFederated LearningUncertainty-Aware (Un)Supervised Few-Shot User Adaptation for On-Device Personalized Human Activity Recognition
Sensor-based Human Activity Recognition (HAR) models often degrade on unseen users due to domain shifts caused by individual movement patterns and sensor placement. Practical wearable HAR systems therefore require person…
Human Activity Recognition