Multi-velocity neural networks for gesture recognition in videos
We present a new action recognition deep neural network which adaptively learns the best action velocities in addition to the classification. While deep neural networks have reached maturity for image understanding tasks, we are still exploring network topologies and features to handle the richer environment of video clips. Here, we tackle the problem of multiple velocities in action recognition, and provide state-of-the-art results for gesture recognition, on known and new collected datasets. We further provide the training steps for our semi-supervised network, suited to learn from huge unlabeled datasets with only a fraction of labeled examples.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionGeneral ClassificationGesture RecognitionTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Simultaneous Segmentation and Recognition: Towards more accurate Ego Gesture Recognition
Ego hand gestures can be used as an interface in AR and VR environments. While the context of an image is important for tasks like scene understanding, object recognition, image caption generation and activity recognitio…
Activity RecognitionCaption GenerationGesture RecognitionHand Gesture Recognition+4Deep Fisher Discriminant Learning for Mobile Hand Gesture Recognition
Gesture recognition is a challenging problem in the field of biometrics. In this paper, we integrate Fisher criterion into Bidirectional Long-Short Term Memory (BLSTM) network and Bidirectional Gated Recurrent Unit (BGRU…
Gesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionG3R: Generating Rich and Fine-grained mmWave Radar Data from 2D Videos for Generalized Gesture Recognition
Millimeter wave radar is gaining traction recently as a promising modality for enabling pervasive and privacy-preserving gesture recognition. However, the lack of rich and fine-grained radar datasets hinders progress in …
DecoderGesture RecognitionPrivacy PreservingAn Evaluation of Large Pre-Trained Models for Gesture Recognition using Synthetic Videos
In this work, we explore the possibility of using synthetically generated data for video-based gesture recognition with large pre-trained models. We consider whether these models have sufficiently robust and expressive r…
ClassificationGesture Recognitionzero-shot-classificationZero-Shot LearningAdversary Helps: Gradient-based Device-Free Domain-Independent Gesture Recognition
Wireless signal-based gesture recognition has promoted the developments of VR game, smart home, etc. However, traditional approaches suffer from the influence of the domain gap. Low recognition accuracy occurs when the r…
Gesture RecognitionTransfer Learning