Curriculum learning for self-supervised speaker verification
The goal of this paper is to train effective self-supervised speaker representations without identity labels. We propose two curriculum learning strategies within a self-supervised learning framework. The first strategy aims to gradually increase the number of speakers in the training phase by enlarging the used portion of the train dataset. The second strategy applies various data augmentations to more utterances within a mini-batch as the training proceeds. A range of experiments conducted using the DINO self-supervised framework on the VoxCeleb1 evaluation protocol demonstrates the effectiveness of our proposed curriculum learning strategies. We report a competitive equal error rate of 4.47% with a single-phase training, and we also demonstrate that the performance further improves to 1.84% by fine-tuning on a small labelled dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Self-Supervised LearningSpeaker RecognitionSpeaker VerificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pushing the limits of self-supervised speaker verification using regularized distillation framework
Training robust speaker verification systems without speaker labels has long been a challenging task. Previous studies observed a large performance gap between self-supervised and fully supervised methods. In this paper,…
Data AugmentationDiversitySelf-Supervised LearningSpeaker VerificationSelf-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision
Training speaker-discriminative and robust speaker verification systems without explicit speaker labels remains a persistent challenge. In this paper, we propose a novel self-supervised speaker verification approach, Sel…
DiversityRepresentation LearningSpeaker VerificationTransfer LearningSelf-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision
Training speaker-discriminative and robust speaker verification systems without explicit speaker labels remains a persisting challenge. In this paper, we propose a new self-supervised speaker verification approach, Self-…
DiversityRepresentation LearningSpeaker VerificationTransfer LearningExperimenting with Additive Margins for Contrastive Self-Supervised Speaker Verification
Most state-of-the-art self-supervised speaker verification systems rely on a contrastive-based objective function to learn speaker representations from unlabeled speech data. We explore different ways to improve the perf…
Speaker VerificationSelf-Supervised Speaker Verification with Simple Siamese Network and Self-Supervised Regularization
Training speaker-discriminative and robust speaker verification systems without speaker labels is still challenging and worthwhile to explore. In this study, we propose an effective self-supervised learning framework and…
Contrastive LearningData AugmentationRepresentation LearningSelf-Supervised Learning+1