paper-with-me

홈 › Papers

Indian Sign Language Detection for Real-Time Translation using Machine Learning

2025-07-27 · Rajat Singhal, Jatin Gupta, Akhil Sharma, Anushka Gupta, Navya Sharma arxiv

Gestural language is used by deaf & mute communities to communicate through hand gestures & body movements that rely on visual-spatial patterns known as sign languages. Sign languages, which rely on visual-spatial patterns of hand gestures & body movements, are the primary mode of communication for deaf & mute communities worldwide. Effective communication is fundamental to human interaction, yet individuals in these communities often face significant barriers due to a scarcity of skilled interpreters & accessible translation technologies. This research specifically addresses these challenges within the Indian context by focusing on Indian Sign Language (ISL). By leveraging machine learning, this study aims to bridge the critical communication gap for the deaf & hard-of-hearing population in India, where technological solutions for ISL are less developed compared to other global sign languages. We propose a robust, real-time ISL detection & translation system built upon a Convolutional Neural Network (CNN). Our model is trained on a comprehensive ISL dataset & demonstrates exceptional performance, achieving a classification accuracy of 99.95%. This high precision underscores the model's capability to discern the nuanced visual features of different signs. The system's effectiveness is rigorously evaluated using key performance metrics, including accuracy, F1 score, precision & recall, ensuring its reliability for real-world applications. For real-time implementation, the framework integrates MediaPipe for precise hand tracking & motion detection, enabling seamless translation of dynamic gestures. This paper provides a detailed account of the model's architecture, the data preprocessing pipeline & the classification methodology. The research elaborates the model architecture, preprocessing & classification methodologies for enhancing communication in deaf & mute communities.

📄 PDF Abstract BibTeX arXiv:2507.20414

Code (0)

등록된 구현이 없습니다.

Tasks

Motion Detection

Similar Papers 제목 키워드 기반

Zero-shot Disfluency Detection for Indian Languages

2022-10-01 · COLING 2022 10 · Rohit Kundu, Preethi Jyothi, Pushpak Bhattacharyya

Disfluencies that appear in the transcriptions from automatic speech recognition systems tend to impair the performance of downstream NLP tasks. Disfluency correction models can help alleviate this problem. However, the …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Real-time Indian Sign Language (ISL) Recognition

2021-08-24 · Kartik Shenoy, Tejas Dastane, Varun Rao, Devendra Vyavaharkar

This paper presents a system which can recognise hand poses & gestures from the Indian Sign Language (ISL) in real-time using grid-based features. This system attempts to bridge the communication gap between the hearing …

Face DetectionGesture RecognitionHand Detection

A Multi-task Model for Multilingual Trigger Detection and Classification

2019-12-01 · ICON 2019 12 · Sovan Kumar Sahoo, Saumajit Saha, Asif Ekbal, Pushpak Bhattacharyya

In this paper we present a deep multi-task learning framework for multilingual event and argument trigger detection and classification. In our current work, we identify detection and classification of both event and argu…

ClassificationMulti-Task Learning

Sign Language Recognition System using TensorFlow Object Detection API

2022-01-05 · Sharvani Srivastava, Amisha Gangwar, Richa Mishra, Sudhakar Singh

Communication is defined as the act of sharing or exchanging information, ideas or feelings. To establish communication between two people, both of them are required to have knowledge and understanding of a common langua…

Objectobject-detectionObject DetectionSign Language Recognition+1

Utilizing Wordnets for Cognate Detection among Indian Languages

2021-12-30 · GWC 2019 7 · Diptesh Kanojia, Kevin Patel, Pushpak Bhattacharyya, Malhar Kulkarni 외

Automatic Cognate Detection (ACD) is a challenging task which has been utilized to help NLP applications like Machine Translation, Information Retrieval and Computational Phylogenetics. Unidentified cognate pairs can pos…

Information RetrievalMachine TranslationRetrieval