Masked Proxy Loss For Text-Independent Speaker Verification
Open-set speaker recognition can be regarded as a metric learning problem, which is to maximize inter-class variance and minimize intra-class variance. Supervised metric learning can be categorized into entity-based learning and proxy-based learning. Most of the existing metric learning objectives like Contrastive, Triplet, Prototypical, GE2E, etc all belong to the former division, the performance of which is either highly dependent on sample mining strategy or restricted by insufficient label information in the mini-batch. Proxy-based losses mitigate both shortcomings, however, fine-grained connections among entities are either not or indirectly leveraged. This paper proposes a Masked Proxy (MP) loss which directly incorporates both proxy-based relationships and pair-based relationships. We further propose Multinomial Masked Proxy (MMP) loss to leverage the hardness of speaker pairs. These methods have been applied to evaluate on VoxCeleb test set and reach state-of-the-art Equal Error Rate(EER).
Code (1)
Tasks
Metric LearningSpeaker RecognitionSpeaker VerificationText-Independent Speaker RecognitionText-Independent Speaker VerificationTripletSimilar Papers 제목 키워드 기반
Frame-level speaker embeddings for text-independent speaker recognition and analysis of end-to-end model
In this paper, we propose a Convolutional Neural Network (CNN) based speaker recognition model for extracting robust speaker embeddings. The embedding can be extracted efficiently with linear activation in the embedding …
Speaker RecognitionText-Independent Speaker RecognitionDeep multi-metric learning for text-independent speaker verification
Text-independent speaker verification is an important artificial intelligence problem that has a wide spectrum of applications, such as criminal investigation, payment certification, and interest-based customer services.…
Metric LearningSpeaker VerificationText-Independent Speaker VerificationTripletPartial AUC optimization based deep speaker embeddings with class-center learning for text-independent speaker verification
Deep embedding based text-independent speaker verification has demonstrated superior performance to traditional methods in many challenging scenarios. Its loss functions can be generally categorized into two classes, i.e…
Speaker VerificationText-Independent Speaker VerificationFew Shot Text-Independent speaker verification using 3D-CNN
Facial recognition system is one of the major successes of Artificial intelligence and has been used a lot over the last years. But, images are not the only biometric present: audio is another possible biometric that can…
Speaker VerificationText-Independent Speaker VerificationAn End-to-End Text-independent Speaker Verification Framework with a Keyword Adversarial Network
This paper presents an end-to-end text-independent speaker verification framework by jointly considering the speaker embedding (SE) network and automatic speech recognition (ASR) network. The SE network learns to output …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Speaker Verificationspeech-recognition+3