paper-with-me

Papers

Resource-Efficient Speech Quality Prediction through Quantization Aware Training and Binary Activation Maps

2024-07-05 · Mattias Nilsson, Riccardo Miccini, Clément Laroche, Tobias Piechowiak, Friedemann Zenke

As speech processing systems in mobile and edge devices become more commonplace, the demand for unintrusive speech quality monitoring increases. Deep learning methods provide high-quality estimates of objective and subjective speech quality metrics. However, their significant computational requirements are often prohibitive on resource-constrained devices. To address this issue, we investigated binary activation maps (BAMs) for speech quality prediction on a convolutional architecture based on DNSMOS. We show that the binary activation model with quantization aware training matches the predictive performance of the baseline model. It further allows using other compression techniques. Combined with 8-bit weight quantization, our approach results in a 25-fold memory reduction during inference, while replacing almost all dot products with summations. Our findings show a path toward substantial resource savings by supporting mixed-precision binary multiplication in hard- and software.

📄 PDF Abstract BibTeX arXiv:2407.04578

Code (1)

fmi-basel/binary-activation-maps-sqp 공식 구현 pytorch

Tasks

Quantization

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Self-Supervised Speech Quality Estimation and Enhancement Using Only Clean Speech

2024-02-26 · Szu-Wei Fu, Kuo-Hsuan Hung, Yu Tsao, Yu-Chiang Frank Wang

Speech quality estimation has recently undergone a paradigm shift from human-hearing expert designs to machine-learning models. However, current models rely mainly on supervised learning, which is time-consuming and expe…

QuantizationSpeech Enhancement

Improving LPCNet-based Text-to-Speech with Linear Prediction-structured Mixture Density Network

2020-01-31 · Min-Jae Hwang, Eunwoo Song, Ryuichi Yamamoto, Frank Soong 외

In this paper, we propose an improved LPCNet vocoder using a linear prediction (LP)-structured mixture density network (MDN). The recently proposed LPCNet vocoder has successfully achieved high-quality and lightweight sp…

QuantizationSpeech Synthesistext-to-speechText to Speech

QUADS: QUAntized Distillation Framework for Efficient Speech Language Understanding

2025-05-19 · Subrata Biswas, Mohammad Nur Hossain Khan, Bashima Islam

Spoken Language Understanding (SLU) systems must balance performance and efficiency, particularly in resource-constrained environments. Existing methods apply distillation and quantization separately, leading to suboptim…

QuantizationSpoken Language Understanding

Low Bit-Rate Wideband Speech Coding: A Deep Generative Model based Approach

2021-02-04 · Gang Min, Xiongwei Zhang, Xia Zou, Xiangyang Liu

Traditional low bit-rate speech coding approach only handles narrowband speech at 8kHz, which limits further improvements in speech quality. Motivated by recent successful exploration of deep learning methods for image a…

Quantization

Pushing the Limits of On-Device Streaming ASR: A Compact, High-Accuracy English Model for Low-Latency Inference

2026-04-16 · Nenad Banfic, David Fan, Kunal Vaishnavi, Sam Kemp 외 arxiv

Deploying high-quality automatic speech recognition (ASR) on edge devices requires models that jointly optimize accuracy, latency, and memory footprint while operating entirely on CPU without GPU acceleration. We conduct…

Speech Recognition