paper-with-me

홈 › Papers

Unsupervised Representation Learning for Speaker Recognition via Contrastive Equilibrium Learning

2020-10-22 · Sung Hwan Mun, Woo Hyun Kang, Min Hyun Han, Nam Soo Kim

In this paper, we propose a simple but powerful unsupervised learning method for speaker recognition, namely Contrastive Equilibrium Learning (CEL), which increases the uncertainty on nuisance factors latent in the embeddings by employing the uniformity loss. Also, to preserve speaker discriminability, a contrastive similarity loss function is used together. Experimental results showed that the proposed CEL significantly outperforms the state-of-the-art unsupervised speaker verification systems and the best performing model achieved 8.01% and 4.01% EER on VoxCeleb1 and VOiCES evaluation sets, respectively. On top of that, the performance of the supervised speaker embedding networks trained with initial parameters pre-trained via CEL showed better performance than those trained with randomly initialized parameters.

📄 PDF Abstract BibTeX arXiv:2010.11433

Code (1)

msh9184/contrastive-equilibrium-learning 공식 구현 pytorch

Tasks

Representation LearningSpeaker RecognitionSpeaker Verification

Similar Papers 제목 키워드 기반

Bootstrap Equilibrium and Probabilistic Speaker Representation Learning for Self-supervised Speaker Verification

2021-12-16 · Sung Hwan Mun, Min Hyun Han, Dongjune Lee, JiHwan Kim 외

In this paper, we propose self-supervised speaker representation learning strategies, which comprise of a bootstrap equilibrium speaker representation learning in the front-end and an uncertainty-aware probabilistic spea…

Contrastive LearningRepresentation LearningSpeaker Verification

Momentum Contrast Speaker Representation Learning

2020-10-22

Unsupervised representation learning has shown remarkable achievement by reducing the performance gap with supervised feature learning, especially in the image domain. In this study, to extend the technique of unsupervis…

Contrastive LearningMetric LearningRepresentation LearningSpeaker Recognition+1

Non-Contrastive Self-Supervised Learning of Utterance-Level Speech Representations

2022-08-10 · Jaejin Cho, Raghavendra Pappagari, Piotr Żelasko, Laureano Moro-Velazquez 외

Considering the abundance of unlabeled speech data and the high labeling costs, unsupervised learning methods can be essential for better system development. One of the most successful methods is contrastive self-supervi…

Emotion RecognitionSelf-Supervised LearningSpeaker Verification

Robust Speaker Recognition with Transformers Using wav2vec 2.0

2022-03-28 · Sergey Novoselov, Galina Lavrentyeva, Anastasia Avdeeva, Vladimir Volokhov 외

Recent advances in unsupervised speech representation learning discover new approaches and provide new state-of-the-art for diverse types of speech processing tasks. This paper presents an investigation of using wav2vec …

Data AugmentationRepresentation LearningSpeaker RecognitionSpeaker Verification+1

Augmentation adversarial training for self-supervised speaker recognition

2020-07-23 · Jaesung Huh, Hee Soo Heo, Jingu Kang, Shinji Watanabe 외

The goal of this work is to train robust speaker recognition models without speaker labels. Recent works on unsupervised speaker representations are based on contrastive learning in which they encourage within-utterance …

Contrastive LearningSpeaker Recognition