paper-with-me

홈 › Papers

Low Bit-Rate Wideband Speech Coding: A Deep Generative Model based Approach

2021-02-04 · Gang Min, Xiongwei Zhang, Xia Zou, Xiangyang Liu

Traditional low bit-rate speech coding approach only handles narrowband speech at 8kHz, which limits further improvements in speech quality. Motivated by recent successful exploration of deep learning methods for image and speech compression, this paper presents a new approach through vector quantization (VQ) of mel-frequency cepstral coefficients (MFCCs) and using a deep generative model called WaveGlow to provide efficient and high-quality speech coding. The coding feature is sorely an 80-dimension MFCCs vector for 16kHz wideband speech, then speech coding at the bit-rate throughout 1000-2000 bit/s could be scalably implemented by applying different VQ schemes for MFCCs vector. This new deep generative network based codec works fast as the WaveGlow model abandons the sample-by-sample autoregressive mechanism. We evaluated this new approach over the multi-speaker TIMIT corpus, and experimental results demonstrate that it provides better speech quality compared with the state-of-the-art classic MELPe codec at lower bit-rate.

📄 PDF Abstract BibTeX arXiv:2102.02640

Code (0)

등록된 구현이 없습니다.

Tasks

Quantization

Methods 이 논문이 사용한 방법론

Affine Coupling 설명 없음
Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…
Invertible 1x1 Convolution The Invertible 1x1 Convolution is a type of convolution used in flow-based generative models that reverses the ordering of…
WaveGlow WaveGlow is a flow-based generative model that generates audio by sampling from a distribution. Specifically samples are taken from a zero mean spherical Gaussian with the…

Similar Papers 제목 키워드 기반

A lightweight and robust method for blind wideband-to-fullband extension of speech

2024-12-16 · Jan Büthe, Jean-Marc Valin

Reducing the bandwidth of speech is common practice in resource constrained environments like low-bandwidth speech transmission or low-complexity vocoding. We propose a lightweight and robust method for extending the ban…

Bandwidth Extension

A Streamwise GAN Vocoder for Wideband Speech Coding at Very Low Bit Rate

2021-08-09 · Ahmed Mustafa, Jan Büthe, Srikanth Korse, Kishan Gupta 외

Recently, GAN vocoders have seen rapid progress in speech synthesis, starting to outperform autoregressive models in perceptual quality with much higher generation speed. However, autoregressive vocoders are still the co…

Speech Synthesis

Improving Opus Low Bit Rate Quality with Neural Speech Synthesis

2020-08-10

The voice mode of the Opus audio coder can compress wideband speech at bit rates ranging from 6 kb/s to 40 kb/s. However, Opus is at its core a waveform matching coder, and as the rate drops below 10 kb/s, quality degrad…

DecoderSpeech Synthesis

UBGAN: Enhancing Coded Speech with Blind and Guided Bandwidth Extension

2025-05-22 · Kishan Gupta, Srikanth Korse, Andreas Brendel, Nicola Pia 외

In practical application of speech codecs, a multitude of factors such as the quality of the radio connection, limiting hardware or required user experience necessitate trade-offs between achievable perceptual quality, e…

Bandwidth ExtensionGenerative Adversarial Network

NESC: Robust Neural End-2-End Speech Coding with GANs

2022-07-07 · Nicola Pia, Kishan Gupta, Srikanth Korse, Markus Multrus 외

Neural networks have proven to be a formidable tool to tackle the problem of speech coding at very low bit rates. However, the design of a neural coder that can be operated robustly under real-world conditions remains a …

Decoder