Model Compression for DNN-based Speaker Verification Using Weight Quantization
DNN-based speaker verification (SV) models demonstrate significant performance at relatively high computation costs. Model compression can be applied to reduce the model size for lower resource consumption. The present study exploits weight quantization to compress two widely-used SV models, namely ECAPA-TDNN and ResNet. Experimental results on VoxCeleb show that weight quantization is effective for compressing SV models. The model size can be reduced multiple times without noticeable degradation in performance. Compression of ResNet shows more robust results than ECAPA-TDNN with lower-bitwidth quantization. Analysis of the layer weights suggests that the smooth weight distribution of ResNet may be related to its better robustness. The generalization ability of the quantized model is validated via a language-mismatched SV task. Furthermore, analysis by information probing reveals that the quantized models can retain most of the speaker-relevant knowledge learned by the original models.
Code (0)
등록된 구현이 없습니다.
Tasks
Model CompressionQuantizationSpeaker VerificationText-Independent Speaker VerificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Lightweight Speaker Verification via Adaptive Neural Network Quantization
Modern speaker verification (SV) systems typically demand expensive storage and computing resources, thereby hindering their deployment on mobile devices. In this paper, we explore adaptive neural network quantization fo…
QuantizationSpeaker VerificationOn Low-Bit Quantization Errors in Speaker Verification: Diagnostic and Mitigation
Although low-bit quantization provides practical means to deploy speaker verification on resource-constrained devices, its effects on speaker verification performance remain poorly understood. In this paper, we study uni…
Speaker VerificationOptimization of DNN-based speaker verification model through efficient quantization technique
As Deep Neural Networks (DNNs) rapidly advance in various fields, including speech verification, they typically involve high computational costs and substantial memory consumption, which can be challenging to manage on m…
QuantizationSpeaker VerificationDiscrete Audio Representation as an Alternative to Mel-Spectrograms for Speaker and Speech Recognition
Discrete audio representation, aka audio tokenization, has seen renewed interest driven by its potential to facilitate the application of text language modeling approaches in audio domain. To this end, various compressio…
Language ModelingLanguage ModellingQuantizationRepresentation Learning+3MUC-G4: Minimal Unsat Core-Guided Incremental Verification for Deep Neural Network Compression
The rapid development of deep learning has led to challenges in deploying neural networks on edge devices, mainly due to their high memory and runtime complexity. Network compression techniques, such as quantization and …
Neural Network CompressionQuantization