WiOpen: A Robust Wi-Fi-based Open-set Gesture Recognition Framework
Recent years have witnessed a growing interest in Wi-Fi-based gesture recognition. However, existing works have predominantly focused on closed-set paradigms, where all testing gestures are predefined during training. This poses a significant challenge in real-world applications, as unseen gestures might be misclassified as known classes during testing. To address this issue, we propose WiOpen, a robust Wi-Fi-based Open-Set Gesture Recognition (OSGR) framework. Implementing OSGR requires addressing challenges caused by the unique uncertainty in Wi-Fi sensing. This uncertainty, resulting from noise and domains, leads to widely scattered and irregular data distributions in collected Wi-Fi sensing data. Consequently, data ambiguity between classes and challenges in defining appropriate decision boundaries to identify unknowns arise. To tackle these challenges, WiOpen adopts a two-fold approach to eliminate uncertainty and define precise decision boundaries. Initially, it addresses uncertainty induced by noise during data preprocessing by utilizing the CSI ratio. Next, it designs the OSGR network based on an uncertainty quantification method. Throughout the learning process, this network effectively mitigates uncertainty stemming from domains. Ultimately, the network leverages relationships among samples' neighbors to dynamically define open-set decision boundaries, successfully realizing OSGR. Comprehensive experiments on publicly accessible datasets confirm WiOpen's effectiveness. Notably, WiOpen also demonstrates superiority in cross-domain tasks when compared to state-of-the-art approaches.
Code (1)
Tasks
Gesture RecognitionUncertainty QuantificationSimilar Papers 제목 키워드 기반
On-device Real-time Custom Hand Gesture Recognition
Most existing hand gesture recognition (HGR) systems are limited to a predefined set of gestures. However, users and developers often want to recognize new, unseen gestures. This is challenging due to the vast diversity …
Gesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionGesture Recognition in RGB Videos UsingHuman Body Keypoints and Dynamic Time Warping
Gesture recognition opens up new ways for humans to intuitively interact with machines. Especially for service robots, gestures can be a valuable addition to the means of communication to, for example, draw the robot's a…
Dynamic Time WarpingGeneral ClassificationGesture RecognitionTime Series+2Towards Open-World Gesture Recognition
Providing users with accurate gestural interfaces, such as gesture recognition based on wrist-worn devices, is a key challenge in mixed reality. However, static machine learning processes in gesture recognition assume th…
Continual LearningGesture RecognitionMixed RealityTowards Open-Set Myoelectric Gesture Recognition via Dual-Perspective Inconsistency Learning
Gesture recognition based on surface electromyography (sEMG) has achieved significant progress in human-machine interaction (HMI), especially in prosthetic control and movement rehabilitation. However, accurately recogni…
DiversityEnsemble LearningGesture RecognitionOpen Set LearningTowards Open-set Gesture Recognition via Feature Activation Enhancement and Orthogonal Prototype Learning
Gesture recognition is a foundational task in human-machine interaction (HMI). While there has been significant progress in gesture recognition based on surface electromyography (sEMG), accurate recognition of predefined…
Gesture RecognitionOpen Set Learning