Enhanced dynamic sign language recognition using slowfast networks
In this paper, we use the SlowFast Networks developed by the Facebook research team to enhance the accuracy of dynamic sign language recognition. Firstly, we prepared the Word-Level American Sign Language (WLASL) dataset so each sign can be considered an action. We used the pre-trained SLOWFAST_8×8_R50 model provided on the official PySlowFast Github repository to initialize the weights of our model and fine-tune using the WLASL dataset and performed a parameter sweeping to fit the Dynamic Sign Language Recognition task. Through this transfer learning approach, we introduced a new state-of-the-art accuracy on the WLASL300 (300 words e.g., 300 classes) dataset with an improvement of 23.2 % top-1 accuracy compared to the previous state-of-the-art introduced in the WLASL paper using an I3D model. The top-1 accuracy was improved from 56.14% to 79.34% and the top-5 accuracy from 79.94% to 90.31%.
Code (0)
등록된 구현이 없습니다.
Tasks
Sign Language RecognitionTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SlowFast Network for Continuous Sign Language Recognition
The objective of this work is the effective extraction of spatial and dynamic features for Continuous Sign Language Recognition (CSLR). To accomplish this, we utilise a two-pathway SlowFast network, where each pathway op…
Sign Language RecognitionSlowFast Networks for Video Recognition
We present SlowFast networks for video recognition. Our model involves (i) a Slow pathway, operating at low frame rate, to capture spatial semantics, and (ii) a Fast pathway, operating at high frame rate, to capture moti…
Action ClassificationAction DetectionAction RecognitionAction Recognition In Videos+2Audiovisual SlowFast Networks for Video Recognition
We present Audiovisual SlowFast Networks, an architecture for integrated audiovisual perception. AVSlowFast has Slow and Fast visual pathways that are deeply integrated with a Faster Audio pathway to model vision and sou…
Action ClassificationVideo RecognitionChallenge report:VIPriors Action Recognition Challenge
This paper is a brief report to our submission to the VIPriors Action Recognition Challenge. Action recognition has attracted many researchers attention for its full application, but it is still challenging. In this pape…
Action RecognitionSlowFastVAD: Video Anomaly Detection via Integrating Simple Detector and RAG-Enhanced Vision-Language Model
Video anomaly detection (VAD) aims to identify unexpected events in videos and has wide applications in safety-critical domains. While semi-supervised methods trained on only normal samples have gained traction, they oft…
Anomaly DetectionDomain AdaptationLanguage ModelingLanguage Modelling+4