paper-with-me

Papers

Improved RawNet with Feature Map Scaling for Text-independent Speaker Verification using Raw Waveforms

2020-04-01 · Jee-weon Jung, Seung-bin Kim, Hye-jin Shim, Ju-ho Kim, Ha-Jin Yu

Recent advances in deep learning have facilitated the design of speaker verification systems that directly input raw waveforms. For example, RawNet extracts speaker embeddings from raw waveforms, which simplifies the process pipeline and demonstrates competitive performance. In this study, we improve RawNet by scaling feature maps using various methods. The proposed mechanism utilizes a scale vector that adopts a sigmoid non-linear function. It refers to a vector with dimensionality equal to the number of filters in a given feature map. Using a scale vector, we propose to scale the feature map multiplicatively, additively, or both. In addition, we investigate replacing the first convolution layer with the sinc-convolution layer of SincNet. Experiments performed on the VoxCeleb1 evaluation dataset demonstrate the effectiveness of the proposed methods, and the best performing system reduces the equal error rate by half compared to the original RawNet. Expanded evaluation results obtained using the VoxCeleb1-E and VoxCeleb-H protocols marginally outperform existing state-of-the-art systems.

📄 PDF Abstract BibTeX arXiv:2004.00526

Code (2)

Jungjee/RawNet 공식 구현 tf
shangeth/wavencoder pytorch

Tasks

Speaker VerificationText-Independent Speaker Verification

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

RawNet: Fast End-to-End Neural Vocoder

2019-04-10 · Yunchao He, Yujun Wang

Neural network-based vocoders have recently demonstrated the powerful ability to synthesize high-quality speech. These models usually generate samples by conditioning on spectral features, such as Mel-spectrogram and fun…

Speech Synthesis

FDN: Finite Difference Network with Hierarchical Convolutional Features for Text-independent Speaker Verification

2021-08-18 · Jin Li, Nan Yan, Lan Wang

In recent years, using raw waveforms as input for deep networks has been widely explored for the speaker verification system. For example, RawNet and RawNet2 extracted speaker's feature embeddings from waveforms automati…

RhythmSpeaker VerificationText-Independent Speaker Verification

MR-RawNet: Speaker verification system with multiple temporal resolutions for variable duration utterances using raw waveforms

2024-06-11 · Seung-bin Kim, Chan-yeong Lim, Jungwoo Heo, Ju-ho Kim 외

In speaker verification systems, the utilization of short utterances presents a persistent challenge, leading to performance degradation primarily due to insufficient phonetic information to characterize the speakers. To…

Speaker Verification

Complementing Handcrafted Features with Raw Waveform Using a Light-weight Auxiliary Model

2021-09-06 · Zhongwei Teng, Quchen Fu, Jules White, Maria Powell 외

An emerging trend in audio processing is capturing low-level speech representations from raw waveforms. These representations have shown promising results on a variety of tasks, such as speech recognition and speech sepa…

speech-recognitionSpeech RecognitionSpeech Separation

End-to-end anti-spoofing with RawNet2

2020-11-02 · Hemlata Tak, Jose Patino, Massimiliano Todisco, Andreas Nautsch 외

Spoofing countermeasures aim to protect automatic speaker verification systems from attempts to manipulate their reliability with the use of spoofed speech signals. While results from the most recent ASVspoof 2019 evalua…

Audio Deepfake DetectionSpeaker Verification