paper-with-me

홈 › Papers

Advanced Arabic Alphabet Sign Language Recognition Using Transfer Learning and Transformer Models

2024-10-01 · Mazen Balat, Rewaa Awaad, Hend Adel, Ahmed B. Zaky, Salah A. Aly

This paper presents an Arabic Alphabet Sign Language recognition approach, using deep learning methods in conjunction with transfer learning and transformer-based models. We study the performance of the different variants on two publicly available datasets, namely ArSL2018 and AASL. This task will make full use of state-of-the-art CNN architectures like ResNet50, MobileNetV2, and EfficientNetB7, and the latest transformer models such as Google ViT and Microsoft Swin Transformer. These pre-trained models have been fine-tuned on the above datasets in an attempt to capture some unique features of Arabic sign language motions. Experimental results present evidence that the suggested methodology can receive a high recognition accuracy, by up to 99.6\% and 99.43\% on ArSL2018 and AASL, respectively. That is far beyond the previously reported state-of-the-art approaches. This performance opens up even more avenues for communication that may be more accessible to Arabic-speaking deaf and hard-of-hearing, and thus encourages an inclusive society.

📄 PDF Abstract BibTeX arXiv:2410.00681

Code (0)

등록된 구현이 없습니다.

Tasks

Sign Language RecognitionTransfer Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Depthwise Separable Convolution While standard convolution performs the channelwise and spatial-wise computation in one step, Depthwise Separable Convolution …
Batch Normalization 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Design of Arabic Sign Language Recognition Model

2023-01-06 · Muhammad Al-Barham, Ahmad Jamal, Musa Al-Yaman

Deaf people are using sign language for communication, and it is a combination of gestures, movements, postures, and facial expressions that correspond to alphabets and words in spoken languages. The proposed Arabic sign…

Image AugmentationmodelSign Language Recognition

Window-Based Descriptors for Arabic Handwritten Alphabet Recognition: A Comparative Study on a Novel Dataset

2014-11-13 · Marwan Torki, Mohamed E. Hussein, Ahmed Elsallamy, Mahmoud Fayyaz 외

This paper presents a comparative study for window-based descriptors on the application of Arabic handwritten alphabet recognition. We show a detailed experimental evaluation of different descriptors with several classif…

Deep Learning Recognition for Arabic Alphabet Sign Language RGB Dataset

2024-03-11 · Journal of Computer and Communications 2024 3 · Rabie El Kharoua, Xiaoming Jiang

This paper introduces a Convolutional Neural Network (CNN) model for Arabic Sign Language (AASL) recognition, using the AASL dataset. Recognizing the fundamental importance of communication for the hearing-impaired, espe…

Deep LearningImage ClassificationPositionSign Language Recognition

AlexU-Word: A New Dataset for Isolated-Word Closed-Vocabulary Offline Arabic Handwriting Recognition

2014-11-17 · Mohamed E. Hussein, Marwan Torki, Ahmed Elsallamy, Mahmoud Fayyaz

In this paper, we introduce the first phase of a new dataset for offline Arabic handwriting recognition. The aim is to collect a very large dataset of isolated Arabic words that covers all letters of the alphabet in all …

AllHandwriting Recognition

RGB Arabic Alphabets Sign Language Dataset

2023-01-30 · Muhammad Al-Barham, Adham Alsharkawi, Musa Al-Yaman, Mohammad Al-Fetyani 외

This paper introduces the RGB Arabic Alphabet Sign Language (AASL) dataset. AASL comprises 7,856 raw and fully labelled RGB images of the Arabic sign language alphabets, which to our best knowledge is the first publicly …