paper-with-me

Papers

Model Compression for DNN-based Speaker Verification Using Weight Quantization

2022-10-31 · Jingyu Li, Wei Liu, Zhaoyang Zhang, Jiong Wang, Tan Lee

DNN-based speaker verification (SV) models demonstrate significant performance at relatively high computation costs. Model compression can be applied to reduce the model size for lower resource consumption. The present study exploits weight quantization to compress two widely-used SV models, namely ECAPA-TDNN and ResNet. Experimental results on VoxCeleb show that weight quantization is effective for compressing SV models. The model size can be reduced multiple times without noticeable degradation in performance. Compression of ResNet shows more robust results than ECAPA-TDNN with lower-bitwidth quantization. Analysis of the layer weights suggests that the smooth weight distribution of ResNet may be related to its better robustness. The generalization ability of the quantized model is validated via a language-mismatched SV task. Furthermore, analysis by information probing reveals that the quantized models can retain most of the speaker-relevant knowledge learned by the original models.

📄 PDF Abstract BibTeX arXiv:2210.17326

Code (0)

등록된 구현이 없습니다.

Tasks

Model CompressionQuantizationSpeaker VerificationText-Independent Speaker Verification

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Batch Normalization 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Average Pooling 설명 없음
Residual Connection 설명 없음
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…

Similar Papers 제목 키워드 기반

Towards Lightweight Speaker Verification via Adaptive Neural Network Quantization

2024-06-08 · Bei Liu, Haoyu Wang, Yanmin Qian

Modern speaker verification (SV) systems typically demand expensive storage and computing resources, thereby hindering their deployment on mobile devices. In this paper, we explore adaptive neural network quantization fo…

QuantizationSpeaker Verification

On Low-Bit Quantization Errors in Speaker Verification: Diagnostic and Mitigation

2026-06-06 · Hugo Leguillier, Driss Matrouf, Guillaume Lechien, Mickael Rouvier arxiv

Although low-bit quantization provides practical means to deploy speaker verification on resource-constrained devices, its effects on speaker verification performance remain poorly understood. In this paper, we study uni…

Speaker Verification

Optimization of DNN-based speaker verification model through efficient quantization technique

2024-07-12 · Yeona Hong, Woo-Jin Chung, Hong-Goo Kang

As Deep Neural Networks (DNNs) rapidly advance in various fields, including speech verification, they typically involve high computational costs and substantial memory consumption, which can be challenging to manage on m…

QuantizationSpeaker Verification

Discrete Audio Representation as an Alternative to Mel-Spectrograms for Speaker and Speech Recognition

2023-09-19 · Krishna C. Puvvada, Nithin Rao Koluguri, Kunal Dhawan, Jagadeesh Balam 외

Discrete audio representation, aka audio tokenization, has seen renewed interest driven by its potential to facilitate the application of text language modeling approaches in audio domain. To this end, various compressio…

Language ModelingLanguage ModellingQuantizationRepresentation Learning+3

MUC-G4: Minimal Unsat Core-Guided Incremental Verification for Deep Neural Network Compression

2025-06-03 · Jingyang Li, Guoqiang Li

The rapid development of deep learning has led to challenges in deploying neural networks on edge devices, mainly due to their high memory and runtime complexity. Network compression techniques, such as quantization and …

Neural Network CompressionQuantization