Adversarial Reweighting for Speaker Verification Fairness
We address performance fairness for speaker verification using the adversarial reweighting (ARW) method. ARW is reformulated for speaker verification with metric learning, and shown to improve results across different subgroups of gender and nationality, without requiring annotation of subgroups in the training data. An adversarial network learns a weight for each training sample in the batch so that the main learner is forced to focus on poorly performing instances. Using a min-max optimization algorithm, this method improves overall speaker verification fairness. We present three different ARWformulations: accumulated pairwise similarity, pseudo-labeling, and pairwise weighting, and measure their performance in terms of equal error rate (EER) on the VoxCeleb corpus. Results show that the pairwise weighting method can achieve 1.08% overall EER, 1.25% for male and 0.67% for female speakers, with relative EER reductions of 7.7%, 10.1% and 3.0%, respectively. For nationality subgroups, the proposed algorithm showed 1.04% EER for US speakers, 0.76% for UK speakers, and 1.22% for all others. The absolute EER gap between gender groups was reduced from 0.70% to 0.58%, while the standard deviation over nationality groups decreased from 0.21 to 0.19.
Code (0)
등록된 구현이 없습니다.
Tasks
FairnessMetric LearningSpeaker VerificationSimilar Papers 제목 키워드 기반
Fairness and Privacy in Voice Biometrics:A Study of Gender Influences Using wav2vec 2.0
This study investigates the impact of gender information on utility, privacy, and fairness in voice biometric systems, guided by the General Data Protection Regulation (GDPR) mandates, which underscore the need for minim…
Decision MakingFairnessSpeaker VerificationSVEva Fair: A Framework for Evaluating Fairness in Speaker Verification
Despite the success of deep neural networks (DNNs) in enabling on-device voice assistants, increasing evidence of bias and discrimination in machine learning is raising the urgency of investigating the fairness of these …
FairnessSpeaker Verificationspeech-recognitionSpeech RecognitionCausally Disentangled Contrastive Learning for Multilingual Speaker Embeddings
Self-supervised speaker embeddings are widely used in speaker verification systems, but prior work has shown that they often encode sensitive demographic attributes, raising fairness and privacy concerns. This paper inve…
Contrastive LearningSpeaker VerificationA Comparison of Differential Performance Metrics for the Evaluation of Automatic Speaker Verification Fairness
When decisions are made and when personal data is treated by automated processes, there is an expectation of fairness -- that members of different demographic groups receive equitable treatment. This expectation applies …
Face RecognitionFairnessSpeaker VerificationImproving fairness in speaker verification via Group-adapted Fusion Network
Modern speaker verification models use deep neural networks to encode utterance audio into discriminative embedding vectors. During the training process, these networks are typically optimized to differentiate arbitrary …
FairnessSpeaker RecognitionSpeaker Verification