Y-Vector: Multiscale Waveform Encoder for Speaker Embedding
State-of-the-art text-independent speaker verification systems typically use cepstral features or filter bank energies as speech features. Recent studies attempted to extract speaker embeddings directly from raw waveforms and have shown competitive results. In this paper, we propose a novel multi-scale waveform encoder that uses three convolution branches with different time scales to compute speech features from the waveform. These features are then processed by squeeze-and-excitation blocks, a multi-level feature aggregator, and a time delayed neural network (TDNN) to compute speaker embedding. We show that the proposed embeddings outperform existing raw-waveform-based speaker embeddings on speaker verification by a large margin. A further analysis of the learned filters shows that the multi-scale encoder attends to different frequency bands at its different scales while resulting in a more flat overall frequency response than any of the single-scale counterparts.
Code (1)
Tasks
Speaker VerificationText-Independent Speaker VerificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
RawNet: Advanced end-to-end deep neural network using raw waveforms for text-independent speaker verification
Recently, direct modeling of raw waveforms using deep neural networks has been widely studied for a number of tasks in audio domains. In speaker verification, however, utilization of raw waveforms is in its preliminary p…
ClassificationData AugmentationGeneral ClassificationSpeaker Verification+1NWPU-ASLP System for the VoicePrivacy 2022 Challenge
This paper presents the NWPU-ASLP speaker anonymization system for VoicePrivacy 2022 Challenge. Our submission does not involve additional Automatic Speaker Verification (ASV) model or x-vector pool. Our system consists …
Speaker anonymizationSpeaker VerificationS-vectors and TESA: Speaker Embeddings and a Speaker Authenticator Based on Transformer Encoder
One of the most popular speaker embeddings is x-vectors, which are obtained from an architecture that gradually builds a larger temporal context with layers. In this paper, we propose to derive speaker embeddings from Tr…
SentenceSpeaker VerificationImproved RawNet with Feature Map Scaling for Text-independent Speaker Verification using Raw Waveforms
Recent advances in deep learning have facilitated the design of speaker verification systems that directly input raw waveforms. For example, RawNet extracts speaker embeddings from raw waveforms, which simplifies the pro…
Speaker VerificationText-Independent Speaker VerificationDictionary Attacks on Speaker Verification
In this paper, we propose dictionary attacks against speaker verification - a novel attack vector that aims to match a large fraction of speaker population by chance. We introduce a generic formulation of the attack that…
Speaker VerificationVoice Cloning