Hand Gesture Recognition Using Temporal Convolutions and Attention Mechanism
Advances in biosignal signal processing and machine learning, in particular Deep Neural Networks (DNNs), have paved the way for the development of innovative Human-Machine Interfaces for decoding the human intent and controlling artificial limbs. DNN models have shown promising results with respect to other algorithms for decoding muscle electrical activity, especially for recognition of hand gestures. Such data-driven models, however, have been challenged by their need for a large number of trainable parameters and their structural complexity. Here we propose the novel Temporal Convolutions-based Hand Gesture Recognition architecture (TC-HGR) to reduce this computational burden. With this approach, we classified 17 hand gestures via surface Electromyogram (sEMG) signals by the adoption of attention mechanisms and temporal convolutions. The proposed method led to 81.65% and 80.72% classification accuracy for window sizes of 300ms and 200ms, respectively. The number of parameters to train the proposed TC-HGR architecture is 11.9 times less than that of its state-of-the-art counterpart.
Code (0)
등록된 구현이 없습니다.
Tasks
Gesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionSimilar Papers 제목 키워드 기반
Beyond Temporal Pooling: Recurrence and Temporal Convolutions for Gesture Recognition in Video
Recent studies have demonstrated the power of recurrent neural networks for machine translation, image captioning and speech recognition. For the task of capturing temporal structure in video, however, there still remain…
Gesture RecognitionImage CaptioningMachine Translationspeech-recognition+3Spatial-Temporal Attention Res-TCN for Skeleton-Based Dynamic Hand Gesture Recognition
Dynamic hand gesture recognition is a crucial yet challenging task in computer vision. The key of this task lies in an effective extraction of discriminative spatial and temporal features to model the evolutions of diffe…
Gesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionSkeleton Based Action RecognitionHAN: An Efficient Hierarchical Self-Attention Network for Skeleton-Based Gesture Recognition
Previous methods for skeleton-based gesture recognition mostly arrange the skeleton sequence into a pseudo picture or spatial-temporal graph and apply deep Convolutional Neural Network (CNN) or Graph Convolutional Networ…
Gesture RecognitionA Two-stream Neural Network for Pose-based Hand Gesture Recognition
Pose based hand gesture recognition has been widely studied in the recent years. Compared with full body action recognition, hand gesture involves joints that are more spatially closely distributed with stronger collabor…
Action RecognitionGesture RecognitionHand Gesture RecognitionHand-Gesture Recognition+1Attention in Convolutional LSTM for Gesture Recognition
Convolutional long short-term memory (LSTM) networks have been widely used for action/gesture recognition, and different attention mechanisms have also been embedded into the LSTM or the convolutional LSTM (ConvLSTM) net…
Gesture Recognition