Improved RawNet with Feature Map Scaling for Text-independent Speaker Verification using Raw Waveforms
Recent advances in deep learning have facilitated the design of speaker verification systems that directly input raw waveforms. For example, RawNet extracts speaker embeddings from raw waveforms, which simplifies the process pipeline and demonstrates competitive performance. In this study, we improve RawNet by scaling feature maps using various methods. The proposed mechanism utilizes a scale vector that adopts a sigmoid non-linear function. It refers to a vector with dimensionality equal to the number of filters in a given feature map. Using a scale vector, we propose to scale the feature map multiplicatively, additively, or both. In addition, we investigate replacing the first convolution layer with the sinc-convolution layer of SincNet. Experiments performed on the VoxCeleb1 evaluation dataset demonstrate the effectiveness of the proposed methods, and the best performing system reduces the equal error rate by half compared to the original RawNet. Expanded evaluation results obtained using the VoxCeleb1-E and VoxCeleb-H protocols marginally outperform existing state-of-the-art systems.
Code (2)
Tasks
Speaker VerificationText-Independent Speaker VerificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
RawNet: Fast End-to-End Neural Vocoder
Neural network-based vocoders have recently demonstrated the powerful ability to synthesize high-quality speech. These models usually generate samples by conditioning on spectral features, such as Mel-spectrogram and fun…
Speech SynthesisFDN: Finite Difference Network with Hierarchical Convolutional Features for Text-independent Speaker Verification
In recent years, using raw waveforms as input for deep networks has been widely explored for the speaker verification system. For example, RawNet and RawNet2 extracted speaker's feature embeddings from waveforms automati…
RhythmSpeaker VerificationText-Independent Speaker VerificationMR-RawNet: Speaker verification system with multiple temporal resolutions for variable duration utterances using raw waveforms
In speaker verification systems, the utilization of short utterances presents a persistent challenge, leading to performance degradation primarily due to insufficient phonetic information to characterize the speakers. To…
Speaker VerificationComplementing Handcrafted Features with Raw Waveform Using a Light-weight Auxiliary Model
An emerging trend in audio processing is capturing low-level speech representations from raw waveforms. These representations have shown promising results on a variety of tasks, such as speech recognition and speech sepa…
speech-recognitionSpeech RecognitionSpeech SeparationEnd-to-end anti-spoofing with RawNet2
Spoofing countermeasures aim to protect automatic speaker verification systems from attempts to manipulate their reliability with the use of spoofed speech signals. While results from the most recent ASVspoof 2019 evalua…
Audio Deepfake DetectionSpeaker Verification