Sign Language Recognition Without Frame-Sequencing Constraints: A Proof of Concept on the Argentinian Sign Language
Automatic sign language recognition (SLR) is an important topic within the areas of human-computer interaction and machine learning. On the one hand, it poses a complex challenge that requires the intervention of various knowledge areas, such as video processing, image processing, intelligent systems and linguistics. On the other hand, robust recognition of sign language could assist in the translation process and the integration of hearing-impaired people, as well as the teaching of sign language for the hearing population. SLR systems usually employ Hidden Markov Models, Dynamic Time Warping or similar models to recognize signs. Such techniques exploit the sequential ordering of frames to reduce the number of hypothesis. This paper presents a general probabilistic model for sign classification that combines sub-classifiers based on different types of features such as position, movement and handshape. The model employs a bag-of-words approach in all classification steps, to explore the hypothesis that ordering is not essential for recognition. The proposed model achieved an accuracy rate of 97 % on an Argentinian Sign Language dataset containing 64 classes of signs and 3200 samples, providing some evidence that indeed recognition without ordering is possible.
Code (0)
등록된 구현이 없습니다.
Tasks
Dynamic Time WarpingSign Language RecognitionSimilar Papers 제목 키워드 기반
Sign Languague Recognition without frame-sequencing constraints: A proof of concept on the Argentinian Sign Language
Automatic sign language recognition (SLR) is an important topic within the areas of human-computer interaction and machine learning. On the one hand, it poses a complex challenge that requires the intervention of various…
Dynamic Time WarpingSign Language RecognitionFuturistic methods in virus genome evolution using the Third-Generation DNA sequencing and artificial neural networks
The Third-Generation in DNA sequencing has emerged in the last few years using new technologies that allow the production of long-read sequences. Applications of the Third-Generation sequencing enable real-time and on-si…
BIG-bench Machine LearningVirologyA Temporal Sequence Learning for Action Recognition and Prediction
In this work\footnote {This work was supported in part by the National Science Foundation under grant IIS-1212948.}, we present a method to represent a video with a sequence of words, and learn the temporal sequencing of…
Action RecognitionPredictionSentenceSentence ClassificationAdaptive sequencing using nanopores and deep learning of mitochondrial DNA
Nanopore sequencing is an emerging technology that reads DNA by utilizing a unique method of detecting nucleic acid sequences and identifies the various chemical modifications they carry. Deep learning has increased in p…
Deep LearningComputational Performance of a Germline Variant Calling Pipeline for Next Generation Sequencing
With the booming of next generation sequencing technology and its implementation in clinical practice and life science research, the need for faster and more efficient data analysis methods becomes pressing in the field …