Dhvani: A Weakly-supervised Phonemic Error Detection and Personalized Feedback System for Hindi
Computer-Assisted Pronunciation Training (CAPT) has been extensively studied for English. However, there remains a critical gap in its application to Indian languages with a base of 1.5 billion speakers. Pronunciation tools tailored to Indian languages are strikingly lacking despite the fact that millions learn them every year. With over 600 million speakers and being the fourth most-spoken language worldwide, improving Hindi pronunciation is a vital first step toward addressing this gap. This paper proposes 1) Dhvani -- a novel CAPT system for Hindi, 2) synthetic speech generation for Hindi mispronunciations, and 3) a novel methodology for providing personalized feedback to learners. While the system often interacts with learners using Devanagari graphemes, its core analysis targets phonemic distinctions, leveraging Hindi's highly phonetic orthography to analyze mispronounced speech and provide targeted feedback.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Goodness-of-pronunciation without phoneme time alignment
In speech evaluation, an Automatic Speech Recognition (ASR) model often computes time boundaries and phoneme posteriors for input features. However, limited data for ASR training hinders expansion of speech evaluation to…
Speech RecognitionSCaLa: Supervised Contrastive Learning for End-to-End Speech Recognition
End-to-end Automatic Speech Recognition (ASR) models are usually trained to optimize the loss of the whole token sequence, while neglecting explicit phonemic-granularity supervision. This could result in recognition erro…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Contrastive LearningRepresentation Learning+2WeText: Scene Text Detection under Weak Supervision
The requiring of large amounts of annotated training data has become a common constraint on various deep learning systems. In this paper, we propose a weakly supervised scene text detection method (WeText) that trains ro…
Scene Text DetectionText DetectionWeakly-supervised LearningSparse Coding-inspired GAN for Weakly Supervised Hyperspectral Anomaly Detection
Anomaly detection (AD) on hyperspectral images (HSIs) is of great importance in both space exploration and earth observations. However, the challenges caused by insufficient datasets, no labels, and noise corruption subs…
Anomaly DetectionDecoderGenerative Adversarial NetworkWeakly-supervised LearningMARTA: a model for the automatic phonemic grouping of the parkinsonian speech
Parkinson's disease significantly impacts speech, particularly affecting phonemic groups like stop-plosives, fricatives, and affricates. However, its objective impact on the different phonemic groups has been briefly add…
BenchmarkingClassificationMetric Learning