paper-with-me

Papers

Y-Vector: Multiscale Waveform Encoder for Speaker Embedding

2020-10-24 · Ge Zhu, Fei Jiang, Zhiyao Duan

State-of-the-art text-independent speaker verification systems typically use cepstral features or filter bank energies as speech features. Recent studies attempted to extract speaker embeddings directly from raw waveforms and have shown competitive results. In this paper, we propose a novel multi-scale waveform encoder that uses three convolution branches with different time scales to compute speech features from the waveform. These features are then processed by squeeze-and-excitation blocks, a multi-level feature aggregator, and a time delayed neural network (TDNN) to compute speaker embedding. We show that the proposed embeddings outperform existing raw-waveform-based speaker embeddings on speaker verification by a large margin. A further analysis of the learned filters shows that the multi-scale encoder attends to different frequency bands at its different scales while resulting in a more flat overall frequency response than any of the single-scale counterparts.

📄 PDF Abstract BibTeX arXiv:2010.12951

Code (1)

gzhu06/Y-vector 공식 구현 pytorch

Tasks

Speaker VerificationText-Independent Speaker Verification

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

RawNet: Advanced end-to-end deep neural network using raw waveforms for text-independent speaker verification

2019-04-17 · Jee-weon Jung, Hee-Soo Heo, Ju-ho Kim, Hye-jin Shim 외

Recently, direct modeling of raw waveforms using deep neural networks has been widely studied for a number of tasks in audio domains. In speaker verification, however, utilization of raw waveforms is in its preliminary p…

ClassificationData AugmentationGeneral ClassificationSpeaker Verification+1

NWPU-ASLP System for the VoicePrivacy 2022 Challenge

2022-09-24 · Jixun Yao, Qing Wang, Li Zhang, Pengcheng Guo 외

This paper presents the NWPU-ASLP speaker anonymization system for VoicePrivacy 2022 Challenge. Our submission does not involve additional Automatic Speaker Verification (ASV) model or x-vector pool. Our system consists …

Speaker anonymizationSpeaker Verification

S-vectors and TESA: Speaker Embeddings and a Speaker Authenticator Based on Transformer Encoder

2020-08-11 · N J Metilda Sagaya Mary, S Umesh, Sandesh V Katta

One of the most popular speaker embeddings is x-vectors, which are obtained from an architecture that gradually builds a larger temporal context with layers. In this paper, we propose to derive speaker embeddings from Tr…

SentenceSpeaker Verification

Improved RawNet with Feature Map Scaling for Text-independent Speaker Verification using Raw Waveforms

2020-04-01 · Jee-weon Jung, Seung-bin Kim, Hye-jin Shim, Ju-ho Kim 외

Recent advances in deep learning have facilitated the design of speaker verification systems that directly input raw waveforms. For example, RawNet extracts speaker embeddings from raw waveforms, which simplifies the pro…

Speaker VerificationText-Independent Speaker Verification

Dictionary Attacks on Speaker Verification

2022-04-24 · Mirko Marras, Pawel Korus, Anubhav Jain, Nasir Memon

In this paper, we propose dictionary attacks against speaker verification - a novel attack vector that aims to match a large fraction of speaker population by chance. We introduce a generic formulation of the attack that…

Speaker VerificationVoice Cloning