paper-with-me

Papers

Curriculum learning for self-supervised speaker verification

2022-03-28 · Hee-Soo Heo, Jee-weon Jung, Jingu Kang, Youngki Kwon, You Jin Kim, Bong-Jin Lee, Joon Son Chung

The goal of this paper is to train effective self-supervised speaker representations without identity labels. We propose two curriculum learning strategies within a self-supervised learning framework. The first strategy aims to gradually increase the number of speakers in the training phase by enlarging the used portion of the train dataset. The second strategy applies various data augmentations to more utterances within a mini-batch as the training proceeds. A range of experiments conducted using the DINO self-supervised framework on the VoxCeleb1 evaluation protocol demonstrates the effectiveness of our proposed curriculum learning strategies. We report a competitive equal error rate of 4.47% with a single-phase training, and we also demonstrate that the performance further improves to 1.84% by fine-tuning on a small labelled dataset.

📄 PDF Abstract BibTeX arXiv:2203.14525

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised LearningSpeaker RecognitionSpeaker Verification

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…

Similar Papers 제목 키워드 기반

Pushing the limits of self-supervised speaker verification using regularized distillation framework

2022-11-08 · Yafeng Chen, Siqi Zheng, Hui Wang, Luyao Cheng 외

Training robust speaker verification systems without speaker labels has long been a challenging task. Previous studies observed a large performance gap between self-supervised and fully supervised methods. In this paper,…

Data AugmentationDiversitySelf-Supervised LearningSpeaker Verification

Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision

2023-08-05 · Yafeng Chen, Siqi Zheng, Hui Wang, Luyao Cheng 외

Training speaker-discriminative and robust speaker verification systems without explicit speaker labels remains a persistent challenge. In this paper, we propose a novel self-supervised speaker verification approach, Sel…

DiversityRepresentation LearningSpeaker VerificationTransfer Learning

Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision

2024-06-17 · Yafeng Chen, Siqi Zheng, Hui Wang, Luyao Cheng 외

Training speaker-discriminative and robust speaker verification systems without explicit speaker labels remains a persisting challenge. In this paper, we propose a new self-supervised speaker verification approach, Self-…

DiversityRepresentation LearningSpeaker VerificationTransfer Learning

Experimenting with Additive Margins for Contrastive Self-Supervised Speaker Verification

2023-06-06 · Theo Lepage, Reda Dehak

Most state-of-the-art self-supervised speaker verification systems rely on a contrastive-based objective function to learn speaker representations from unlabeled speech data. We explore different ways to improve the perf…

Speaker Verification

Self-Supervised Speaker Verification with Simple Siamese Network and Self-Supervised Regularization

2021-12-08 · Mufan Sang, Haoqi Li, Fang Liu, Andrew O. Arnold 외

Training speaker-discriminative and robust speaker verification systems without speaker labels is still challenging and worthwhile to explore. In this study, we propose an effective self-supervised learning framework and…

Contrastive LearningData AugmentationRepresentation LearningSelf-Supervised Learning+1