paper-with-me

Papers

Learnable Frequency Filters for Speech Feature Extraction in Speaker Verification

2022-06-15 · Jingyu Li, Yusheng Tian, Tan Lee

Mel-scale spectrum features are used in various recognition and classification tasks on speech signals. There is no reason to expect that these features are optimal for all different tasks, including speaker verification (SV). This paper describes a learnable front-end feature extraction model. The model comprises a group of filters to transform the Fourier spectrum. Model parameters that define these filters are trained end-to-end and optimized specifically for the task of speaker verification. Compared to the standard Mel-scale filter-bank, the filters' bandwidths and center frequencies are adjustable. Experimental results show that applying the learnable acoustic front-end improves speaker verification performance over conventional Mel-scale spectrum features. Analysis on the learned filter parameters suggests that narrow-band information benefits the SV system performance. The proposed model achieves a good balance between performance and computation cost. In resource-constrained computation settings, the model significantly outperforms CNN-based learnable front-ends. The generalization ability of the proposed model is also demonstrated on different embedding extraction models and datasets.

📄 PDF Abstract BibTeX arXiv:2206.07563

Code (0)

등록된 구현이 없습니다.

Tasks

Speaker Verification

Similar Papers 제목 키워드 기반

Harmonic enhancement using learnable comb filter for light-weight full-band speech enhancement model

2023-06-01 · Xiaohuai Le, Tong Lei, Li Chen, Yiqing Guo 외

With fewer feature dimensions, filter banks are often used in light-weight full-band speech enhancement models. In order to further enhance the coarse speech in the sub-band domain, it is necessary to apply a post-filter…

RetrievalSpeech Enhancement

Shennong: a Python toolbox for audio speech features extraction

2021-12-10 · Mathieu Bernard, Maxime Poli, Julien Karadayi, Emmanuel Dupoux

We introduce Shennong, a Python toolbox and command-line utility for speech features extraction. It implements a wide range of well-established state of art algorithms including spectro-temporal filters such as Mel-Frequ…

Lightweight End-to-End Speech Recognition from Raw Audio Data Using Sinc-Convolutions

2020-10-15 · Ludwig Kürzinger, Nicolas Lindae, Palle Klewitz, Gerhard Rigoll

Many end-to-end Automatic Speech Recognition (ASR) systems still rely on pre-processed frequency-domain features that are handcrafted to emulate the human hearing. Our work is motivated by recent advances in integrated l…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Neural Harmonic-plus-Noise Waveform Model with Trainable Maximum Voice Frequency for Text-to-Speech Synthesis

2019-08-27

Neural source-filter (NSF) models are deep neural networks that produce waveforms given input acoustic features. They use dilated-convolution-based neural filter modules to filter sine-based excitation for waveform gener…

Speech Synthesistext-to-speechText to SpeechText-To-Speech Synthesis

Optimization of data-driven filterbank for automatic speaker verification

2020-07-21 · Susanta Sarangi, Md Sahidullah, Goutam Saha

Most of the speech processing applications use triangular filters spaced in mel-scale for feature extraction. In this paper, we propose a new data-driven filter design method which optimizes filter parameters from a give…

Speaker Verification