A Non-Anatomical Graph Structure for isolated hand gesture separation in continuous gesture sequences
Continuous Hand Gesture Recognition (CHGR) has been extensively studied by researchers in the last few decades. Recently, one model has been presented to deal with the challenge of the boundary detection of isolated gestures in a continuous gesture video [17]. To enhance the model performance and also replace the handcrafted feature extractor in the presented model in [17], we propose a GCN model and combine it with the stacked Bi-LSTM and Attention modules to push the temporal information in the video stream. Considering the breakthroughs of GCN models for skeleton modality, we propose a two-layer GCN model to empower the 3D hand skeleton features. Finally, the class probabilities of each isolated gesture are fed to the post-processing module, borrowed from [17]. Furthermore, we replace the anatomical graph structure with some non-anatomical graph structures. Due to the lack of a large dataset, including both the continuous gesture sequences and the corresponding isolated gestures, three public datasets in Dynamic Hand Gesture Recognition (DHGR), RKS-PERSIANSIGN, and ASLVID, are used for evaluation. Experimental results show the superiority of the proposed model in dealing with isolated gesture boundaries detection in continuous gesture sequences
Code (0)
등록된 구현이 없습니다.
Tasks
Boundary DetectionGesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Graph Modelling Analysis of Speech-Gesture Interaction for Aphasia Severity Estimation
Aphasia is an acquired language disorder caused by injury to the regions of the brain that are responsible for language. Aphasia may impair the use and comprehension of written and spoken language. The Western Aphasia Ba…
Graph Neural NetworkHand1000: Generating Realistic Hands from Text with Only 1,000 Images
Text-to-image generation models have achieved remarkable advancements in recent years, aiming to produce realistic images from textual descriptions. However, these models often struggle with generating anatomically accur…
AnatomyGesture RecognitionHand Gesture RecognitionHand-Gesture Recognition+4A database of upper limb surface electromyogram signals from demographically diverse individuals
Upper limb based neuromuscular interfaces aim to provide a seamless way for humans to interact with technology. Among noninvasive interfaces, surface electromyogram (EMG) signals hold significant promise. However, their …
Temporal Accumulative Features for Sign Language Recognition
In this paper, we propose a set of features called temporal accumulative features (TAF) for representing and recognizing isolated sign language gestures. By incorporating sign language specific constructs to better repre…
Sign Language RecognitionIPN Hand: A Video Dataset and Benchmark for Real-Time Continuous Hand Gesture Recognition
In this paper, we introduce a new benchmark dataset named IPN Hand with sufficient size, variety, and real-world elements able to train and evaluate deep neural networks. This dataset contains more than 4,000 gesture sam…
Gesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionOptical Flow Estimation+1