paper-with-me

홈 › Papers

End-to-end losses based on speaker basis vectors and all-speaker hard negative mining for speaker verification

2019-02-07 · Hee-Soo Heo, Jee-weon Jung, IL-Ho Yang, Sung-Hyun Yoon, Hye-jin Shim, Ha-Jin Yu

In recent years, speaker verification has primarily performed using deep neural networks that are trained to output embeddings from input features such as spectrograms or Mel-filterbank energies. Studies that design various loss functions, including metric learning have been widely explored. In this study, we propose two end-to-end loss functions for speaker verification using the concept of speaker bases, which are trainable parameters. One loss function is designed to further increase the inter-speaker variation, and the other is designed to conduct the identical concept with hard negative mining. Each speaker basis is designed to represent the corresponding speaker in the process of training deep neural networks. In contrast to the conventional loss functions that can consider only a limited number of speakers included in a mini-batch, the proposed loss functions can consider all the speakers in the training set regardless of the mini-batch composition. In particular, the proposed loss functions enable hard negative mining and calculations of between-speaker variations with consideration of all speakers. Through experiments on VoxCeleb1 and VoxCeleb2 datasets, we confirmed that the proposed loss functions could supplement conventional softmax and center loss functions.

📄 PDF Abstract BibTeX arXiv:1902.02455

Code (0)

등록된 구현이 없습니다.

Tasks

AllMetric LearningSpeaker Verification

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios

2022-04-01 · Yihan Wu, Xu Tan, Bohan Li, Lei He 외

Adaptive text to speech (TTS) can synthesize new voices in zero-shot scenarios efficiently, by using a well-trained source TTS model without adapting it on the speech data of new speakers. Considering seen and unseen spe…

Speech Synthesistext-to-speechText to Speech

Homogeneous Speaker Features for On-the-Fly Dysarthric and Elderly Speaker Adaptation

2024-07-08 · Mengzhe Geng, Xurong Xie, Jiajun Deng, Zengrui Jin 외

The application of data-intensive automatic speech recognition (ASR) technologies to dysarthric and elderly adult speech is confronted by their mismatch against healthy and nonaged voices, data scarcity and large speaker…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1

S-vectors and TESA: Speaker Embeddings and a Speaker Authenticator Based on Transformer Encoder

2020-08-11 · N J Metilda Sagaya Mary, S Umesh, Sandesh V Katta

One of the most popular speaker embeddings is x-vectors, which are obtained from an architecture that gradually builds a larger temporal context with layers. In this paper, we propose to derive speaker embeddings from Tr…

SentenceSpeaker Verification

Speaker conditioned acoustic-to-articulatory inversion using x-vectors

2020-06-20

Speech production involves the movement of various articulators, including tongue, jaw, and lips. Estimating the movement of the articulators from the acoustics of speech is known as acoustic-to-articulatory inversion (A…

Deep Speaker Vectors for Semi Text-independent Speaker Verification

2015-05-24 · Lantian Li, Dong Wang, Zhiyong Zhang, Thomas Fang Zheng

Recent research shows that deep neural networks (DNNs) can be used to extract deep speaker vectors (d-vectors) that preserve speaker characteristics and can be used in speaker verification. This new method has been teste…

Speaker RecognitionSpeaker VerificationText-Dependent Speaker VerificationText-Independent Speaker Recognition+1