Online Hand Gesture Recognition Using 3D Convolutional Neural Networks
In human computer interaction, real-time detection and classification of dynamic hand gestures is challenging as: 1) the system must run in a real-time video stream and there is no noticeable lag in response after performing a gesture; 2) there is a large difference in how people perform gestures, making recognition more difficult. In this paper, an online hand gesture recognition system is proposed, which is able to localize gestures in real-time video stream and recognize what these gestures are. To improve the robustness of the system, the sliding window approach is used to refine results from multiple windows. All of the models in my project are trained on Jester database, achieving 98+% accuracy for detector and 90+% accuracy for classifier. For the overall performance of the system, the best group can respond within three seconds and reach 37.5% Levenshtein accuracy on the homemade dataset. The project codes used in this work are publicly available.
Code (0)
등록된 구현이 없습니다.
Tasks
Hand Gesture RecognitionSimilar Papers 제목 키워드 기반
DriverMHG: A Multi-Modal Dataset for Dynamic Recognition of Driver Micro Hand Gestures and a Real-Time Recognition Framework
The use of hand gestures provides a natural alternative to cumbersome interface devices for Human-Computer Interaction (HCI) systems. However, real-time recognition of dynamic micro hand gestures from video streams is ch…
Doppler-Radar Based Hand Gesture Recognition System Using Convolutional Neural Networks
Hand gesture recognition has long been a hot topic in human computer interaction. Traditional camera-based hand gesture recognition systems cannot work properly under dark circumstances. In this paper, a Doppler Radar ba…
Gesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionUnderstanding the hand-gestures using Convolutional Neural Networks and Generative Adversial Networks
In this paper, it is introduced a hand gesture recognition system to recognize the characters in the real time. The system consists of three modules: real time hand tracking, training gesture and gesture recognition usin…
Gesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionOnline Detection and Classification of Dynamic Hand Gestures With Recurrent 3D Convolutional Neural Network
Automatic detection and classification of dynamic hand gestures in real-world systems intended for human computer interaction is challenging as: 1) there is a large diversity in how people perform gestures, making detect…
ClassificationDiversityGeneral ClassificationGesture RecognitionDeformable Deep Convolutional Generative Adversarial Network in Microwave Based Hand Gesture Recognition System
Traditional vision-based hand gesture recognition systems is limited under dark circumstances. In this paper, we build a hand gesture recognition system based on microwave transceiver and deep learning algorithm. A Doppl…
BIG-bench Machine LearningGenerative Adversarial NetworkGesture RecognitionHand Gesture Recognition+1