Toward Fairness in Speech Recognition: Discovery and mitigation of performance disparities
As for other forms of AI, speech recognition has recently been examined with respect to performance disparities across different user cohorts. One approach to achieve fairness in speech recognition is to (1) identify speaker cohorts that suffer from subpar performance and (2) apply fairness mitigation measures targeting the cohorts discovered. In this paper, we report on initial findings with both discovery and mitigation of performance disparities using data from a product-scale AI assistant speech recognition system. We compare cohort discovery based on geographic and demographic information to a more scalable method that groups speakers without human labels, using speaker embedding technology. For fairness mitigation, we find that oversampling of underrepresented cohorts, as well as modeling speaker cohort membership by additional input variables, reduces the gap between top- and bottom-performing cohorts, without deteriorating overall recognition accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Fairnessspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
To train or not to train adversarially: A study of bias mitigation strategies for speaker recognition
Speaker recognition is increasingly used in several everyday applications including smart speakers, customer care centers and other speech-driven analytics. It is crucial to accurately evaluate and mitigate biases presen…
Face RecognitionFairnessMulti-Task LearningSpeaker RecognitionThe Voice of Equity: A Systematic Evaluation of Bias Mitigation Techniques for Speech-Based Cognitive Impairment Detection Across Architectures and Demographics
Speech-based detection of cognitive impairment offers a scalable, non-invasive screening, yet algorithmic bias across demographic and linguistic subgroups remains critically underexplored. We present the first comprehens…
Bias Discovery in Machine Learning Models for Mental Health
Fairness and bias are crucial concepts in artificial intelligence, yet they are relatively ignored in machine learning applications in clinical psychiatry. We computed fairness metrics and present bias mitigation strateg…
BIG-bench Machine LearningFairnessFairness of Automatic Speech Recognition in Cleft Lip and Palate Speech
Speech produced by individuals with cleft lip and palate (CLP) is often highly nasalized and breathy due to structural anomalies, causing shifts in formant structure that affect automatic speech recognition (ASR) perform…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Fairnessspeech-recognition+1Examining the Interplay Between Privacy and Fairness for Speech Processing: A Review and Perspective
Speech technology has been increasingly deployed in various areas of daily life including sensitive domains such as healthcare and law enforcement. For these technologies to be effective, they must work reliably for all …
Fairness