A Study on Bias and Fairness In Deep Speaker Recognition
With the ubiquity of smart devices that use speaker recognition (SR) systems as a means of authenticating individuals and personalizing their services, fairness of SR systems has becomes an important point of focus. In this paper we study the notion of fairness in recent SR systems based on 3 popular and relevant definitions, namely Statistical Parity, Equalized Odds, and Equal Opportunity. We examine 5 popular neural architectures and 5 commonly used loss functions in training SR systems, while evaluating their fairness against gender and nationality groups. Our detailed experiments shed light on this concept and demonstrate that more sophisticated encoder architectures better align with the definitions of fairness. Additionally, we find that the choice of loss functions can significantly impact the bias of SR models.
Code (0)
등록된 구현이 없습니다.
Tasks
FairnessSpeaker RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
To train or not to train adversarially: A study of bias mitigation strategies for speaker recognition
Speaker recognition is increasingly used in several everyday applications including smart speakers, customer care centers and other speech-driven analytics. It is crucial to accurately evaluate and mitigate biases presen…
Face RecognitionFairnessMulti-Task LearningSpeaker RecognitionSVEva Fair: A Framework for Evaluating Fairness in Speaker Verification
Despite the success of deep neural networks (DNNs) in enabling on-device voice assistants, increasing evidence of bias and discrimination in machine learning is raising the urgency of investigating the fairness of these …
FairnessSpeaker Verificationspeech-recognitionSpeech RecognitionTowards Measuring and Scoring Speaker Diarization Fairness
Speaker diarization, or the task of finding "who spoke and when", is now used in almost every speech processing application. Nevertheless, its fairness has not yet been evaluated because there was no protocol to study it…
FairnessSentencespeaker-diarizationSpeaker DiarizationImproving Fairness in Speaker Recognition
The human voice conveys unique characteristics of an individual, making voice biometrics a key technology for verifying identities in various industries. Despite the impressive progress of speaker recognition systems in …
AttributeFairnessSpeaker RecognitionWhere Do Self-Supervised Speech Models Become Unfair?
Speech encoder models are known to model members of some speaker groups (SGs) better than others. However, there has been little work in establishing why this occurs on a technological level. To our knowledge, we present…
Speaker IdentificationSpeech Recognition