paper-with-me

홈 › Papers

ESPnet-Codec: Comprehensive Training and Evaluation of Neural Codecs for Audio, Music, and Speech

2024-09-24 · Jiatong Shi, Jinchuan Tian, Yihan Wu, Jee-weon Jung, Jia Qi Yip, Yoshiki Masuyama, William Chen, Yuning Wu, Yuxun Tang, Massa Baali, Dareen Alharhi, Dong Zhang, Ruifan Deng, Tejes Srivastava, Haibin Wu, Alexander H. Liu, Bhiksha Raj, Qin Jin, Ruihua Song, Shinji Watanabe

Neural codecs have become crucial to recent speech and audio generation research. In addition to signal compression capabilities, discrete codecs have also been found to enhance downstream training efficiency and compatibility with autoregressive language models. However, as extensive downstream applications are investigated, challenges have arisen in ensuring fair comparisons across diverse applications. To address these issues, we present a new open-source platform ESPnet-Codec, which is built on ESPnet and focuses on neural codec training and evaluation. ESPnet-Codec offers various recipes in audio, music, and speech for training and evaluation using several widely adopted codec models. Together with ESPnet-Codec, we present VERSA, a standalone evaluation toolkit, which provides a comprehensive evaluation of codec performance over 20 audio evaluation metrics. Notably, we demonstrate that ESPnet-Codec can be integrated into six ESPnet tasks, supporting diverse applications.

📄 PDF Abstract BibTeX arXiv:2409.15897

Code (2)

shinjiwlab/versa pytorch
wavlab-speech/versa pytorch

Tasks

Audio Generation

Methods 이 논문이 사용한 방법론

Dilated Convolution 설명 없음
Hierarchical Feature Fusion Hierarchical Feature Fusion (HFF) is a feature fusion method employed in ESP and EESP image…
Kaiming Initialization 설명 없음
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
ESP 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
PReLU A Parametric Rectified Linear Unit, or PReLU, is an activation function that generalizes the traditional rectified unit with a slope for negative values.…

Similar Papers 제목 키워드 기반

LACE: Layer-Wise Compression for Dynamic Frame Rate Codecs

2026-09-15 · Thanapat Trachu, Samuele Cornell, William Chen, Shinji Watanabe arxiv

Neural audio codecs are a key component in speech language modeling. However, their high frame rates lead to long sequence lengths, increasing computational costs. Dynamic frame rate codecs mitigate this by reducing the …

BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec

2024-09-09 · Detai Xin, Xu Tan, Shinnosuke Takamichi, Hiroshi Saruwatari

We present BigCodec, a low-bitrate neural speech codec. While recent neural speech codecs have shown impressive progress, their performance significantly deteriorates at low bitrates (around 1 kbps). Although a low bitra…

Quantization

Speech Separation using Neural Audio Codecs with Embedding Loss

2024-11-27 · Jia Qi Yip, Chin Yuen Kwok, Bin Ma, Eng Siong Chng

Neural audio codecs have revolutionized audio processing by enabling speech tasks to be performed on highly compressed representations. Recent work has shown that speech separation can be achieved within these compressed…

Speech Separation

Efficient Evaluation of Quantization-Effects in Neural Codecs

2025-02-07 · Wolfgang Mack, Ahmed Mustafa, Rafał Łaganowski, Samer Hijazy

Neural codecs, comprising an encoder, quantizer, and decoder, enable signal transmission at exceptionally low bitrates. Training these systems requires techniques like the straight-through estimator, soft-to-hard anneali…

DecoderQuantization

Full Reference Video Quality Assessment for Machine Learning-Based Video Codecs

2023-09-02 · Abrar Majeedi, Babak Naderi, Yasaman Hosseinkashi, Juhee Cho 외

Machine learning-based video codecs have made significant progress in the past few years. A critical area in the development of ML-based video codecs is an accurate evaluation metric that does not require an expensive an…

Video Quality Assessment