paper-with-me

Papers

Self-Supervised Speaker Verification with Simple Siamese Network and Self-Supervised Regularization

2021-12-08 · Mufan Sang, Haoqi Li, Fang Liu, Andrew O. Arnold, Li Wan

Training speaker-discriminative and robust speaker verification systems without speaker labels is still challenging and worthwhile to explore. In this study, we propose an effective self-supervised learning framework and a novel regularization strategy to facilitate self-supervised speaker representation learning. Different from contrastive learning-based self-supervised learning methods, the proposed self-supervised regularization (SSReg) focuses exclusively on the similarity between the latent representations of positive data pairs. We also explore the effectiveness of alternative online data augmentation strategies on both the time domain and frequency domain. With our strong online data augmentation strategy, the proposed SSReg shows the potential of self-supervised learning without using negative pairs and it can significantly improve the performance of self-supervised speaker representation learning with a simple Siamese network architecture. Comprehensive experiments on the VoxCeleb datasets demonstrate that our proposed self-supervised approach obtains a 23.4% relative improvement by adding the effective self-supervised regularization and outperforms other previous works.

📄 PDF Abstract BibTeX arXiv:2112.04459

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningData AugmentationRepresentation LearningSelf-Supervised LearningSpeaker Verification

Methods 이 논문이 사용한 방법론

Siamese Network 설명 없음

Similar Papers 제목 키워드 기반

ACE-VC: Adaptive and Controllable Voice Conversion using Explicitly Disentangled Self-supervised Speech Representations

2023-02-16 · Shehzeen Hussain, Paarth Neekhara, Jocelyn Huang, Jason Li 외

In this work, we propose a zero-shot voice conversion method using speech representations trained with self-supervised learning. First, we develop a multi-task model to decompose a speech utterance into features such as …

Self-Supervised LearningSpeaker VerificationVoice Conversion

Prosodic-Enhanced Siamese Convolutional Neural Networks for Cross-Device Text-Independent Speaker Verification

2018-07-31 · Sobhan Soleymani, Ali Dabouei, Seyed Mehdi Iranmanesh, Hadi Kazemi 외

In this paper a novel cross-device text-independent speaker verification architecture is proposed. Majority of the state-of-the-art deep architectures that are used for speaker verification tasks consider Mel-frequency c…

Speaker VerificationText-Independent Speaker Verification

Self-supervised Text-independent Speaker Verification using Prototypical Momentum Contrastive Learning

2020-12-13 · Wei Xia, Chunlei Zhang, Chao Weng, Meng Yu 외

In this study, we investigate self-supervised representation learning for speaker verification (SV). First, we examine a simple contrastive learning approach (SimCLR) with a momentum contrastive (MoCo) learning framework…

ClusteringContrastive LearningRepresentation LearningSpeaker Verification+1

Pushing the limits of self-supervised speaker verification using regularized distillation framework

2022-11-08 · Yafeng Chen, Siqi Zheng, Hui Wang, Luyao Cheng 외

Training robust speaker verification systems without speaker labels has long been a challenging task. Previous studies observed a large performance gap between self-supervised and fully supervised methods. In this paper,…

Data AugmentationDiversitySelf-Supervised LearningSpeaker Verification

Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision

2023-08-05 · Yafeng Chen, Siqi Zheng, Hui Wang, Luyao Cheng 외

Training speaker-discriminative and robust speaker verification systems without explicit speaker labels remains a persistent challenge. In this paper, we propose a novel self-supervised speaker verification approach, Sel…

DiversityRepresentation LearningSpeaker VerificationTransfer Learning