paper-with-me

홈 › Papers

Improving Speech Recognition for African American English With Audio Classification

2023-09-16 · Shefali Garg, Zhouyuan Huo, Khe Chai Sim, Suzan Schwartz, Mason Chua, Alëna Aksënova, Tsendsuren Munkhdalai, Levi King, Darryl Wright, Zion Mengesha, Dongseong Hwang, Tara Sainath, Françoise Beaufays, Pedro Moreno Mengibar

Automatic speech recognition (ASR) systems have been shown to have large quality disparities between the language varieties they are intended or expected to recognize. One way to mitigate this is to train or fine-tune models with more representative datasets. But this approach can be hindered by limited in-domain data for training and evaluation. We propose a new way to improve the robustness of a US English short-form speech recognizer using a small amount of out-of-domain (long-form) African American English (AAE) data. We use CORAAL, YouTube and Mozilla Common Voice to train an audio classifier to approximately output whether an utterance is AAE or some other variety including Mainstream American English (MAE). By combining the classifier output with coarse geographic information, we can select a subset of utterances from a large corpus of untranscribed short-form queries for semi-supervised learning at scale. Fine-tuning on this data results in a 38.5% relative word error rate disparity reduction between AAE and MAE without reducing MAE quality.

📄 PDF Abstract BibTeX arXiv:2309.09996

Code (0)

등록된 구현이 없습니다.

Tasks

Audio ClassificationAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)Formspeech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

American 설명 없음
MAE 설명 없음

Similar Papers 제목 키워드 기반

Dialect-Specific Models for Automatic Speech Recognition of African American Vernacular English

2019-09-01 · RANLP 2019 9 · Rachel Dorn

African American Vernacular English (AAVE) is a widely-spoken dialect of English, yet it is under-represented in major speech corpora. As a result, speakers of this dialect are often misunderstood by NLP applications. Th…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Diversityspeech-recognition+1

Automatic Speech Recognition of African American English: Lexical and Contextual Effects

2025-06-07 · Hamid Mojarad, Kevin Tang

Automatic Speech Recognition (ASR) models often struggle with the phonetic, phonological, and morphosyntactic features found in African American English (AAE). This study focuses on two key AAE variables: Consonant Clust…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+2

Creating an African American-Sounding TTS: Guidelines, Technical Challenges,and Surprising Evaluations

2024-03-17 · Claudio Pinhanez, Raul Fernandez, Marcelo Grave, Julio Nogima 외

Representations of AI agents in user interfaces and robotics are predominantly White, not only in terms of facial and skin features, but also in the synthetic voices they use. In this paper we explore some unexpected cha…

Attributetext-to-speechText to Speech

Self-supervised Speech Representations Still Struggle with African American Vernacular English

2024-08-26 · Kalvin Chang, Yi-Hui Chou, Jiatong Shi, Hsuan-Ming Chen 외

Underperformance of ASR systems for speakers of African American Vernacular English (AAVE) and other marginalized language varieties is a well-documented phenomenon, and one that reinforces the stigmatization of these va…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Self-Supervised Learningspeech-recognition+1

Racial Bias in Hate Speech and Abusive Language Detection Datasets

2019-05-29 · WS 2019 8 · Thomas Davidson, Debasmita Bhattacharya, Ingmar Weber

Technologies for abusive language detection are being developed and applied with little consideration of their potential biases. We examine racial bias in five different sets of Twitter data annotated for hate speech and…

Abuse DetectionAbusive Language