Unsupervised Domain Adaptation for RF-based Gesture Recognition
Human gesture recognition with Radio Frequency (RF) signals has attained acclaim due to the omnipresence, privacy protection, and broad coverage nature of RF signals. These gesture recognition systems rely on neural networks trained with a large number of labeled data. However, the recognition model trained with data under certain conditions would suffer from significant performance degradation when applied in practical deployment, which limits the application of gesture recognition systems. In this paper, we propose an unsupervised domain adaptation framework for RF-based gesture recognition aiming to enhance the performance of the recognition model in new conditions by making effective use of the unlabeled data from new conditions. We first propose pseudo-labeling and consistency regularization to utilize unlabeled data for model training and eliminate the feature discrepancies in different domains. Then we propose a confidence constraint loss to enhance the effectiveness of pseudo-labeling, and design two corresponding data augmentation methods based on the characteristic of the RF signals to strengthen the performance of the consistency regularization, which can make the framework more effective and robust. Furthermore, we propose a cross-match loss to integrate the pseudo-labeling and consistency regularization, which makes the whole framework simple yet effective. Extensive experiments demonstrate that the proposed framework could achieve 4.35% and 2.25% accuracy improvement comparing with the state-of-the-art methods on public WiFi dataset and millimeter wave (mmWave) radar dataset, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDomain AdaptationGesture RecognitionRF-based Gesture RecognitionUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Domain Adaptive Robotic Gesture Recognition with Unsupervised Kinematic-Visual Data Alignment
Automated surgical gesture recognition is of great importance in robot-assisted minimally invasive surgery. However, existing methods assume that training and testing data are from the same domain, which suffers from sev…
Domain AdaptationGesture RecognitionSurgical Gesture RecognitionUnsupervised Domain AdaptationPGUDA: Pressure-Guided Unsupervised Domain Adaptation with Cross-Modal Knowledge Distillation for sEMG-Based Gesture Recognition
Surface electromyography (sEMG)-based gesture recognition has emerged as a promising technology for natural human-computer interaction. However, its practical deployment remains challenging due to severe performance degr…
Unsupervised Domain AdaptationRepresentation LearningKnowledge DistillationGesture RecognitionDomain Adaptation for sEMG-based Gesture Recognition with Recurrent Neural Networks
Surface Electromyography (sEMG/EMG) is to record muscles' electrical activity from a restricted area of the skin by using electrodes. The sEMG-based gesture recognition is extremely sensitive of inter-session and inter-s…
Domain AdaptationEMG Gesture RecognitionGesture RecognitionOn the Metrics and Adaptation Methods for Domain Divergences of sEMG-based Gesture Recognition
We propose a new metric to measure domain divergence and a new domain adaptation method for time-series classification. The metric belongs to the class of probability distributions-based metrics, is transductive, and doe…
Domain AdaptationGesture RecognitionTime SeriesTime Series Analysis+1Continuous Gesture Recognition from sEMG Sensor Data with Recurrent Neural Networks and Adversarial Domain Adaptation
Movement control of artificial limbs has made big advances in recent years. New sensor and control technology enhanced the functionality and usefulness of artificial limbs to the point that complex movements, such as gra…
Domain AdaptationGesture Recognition