paper-with-me

Papers

One Quantizer is Enough: Toward a Lightweight Audio Codec

2025-04-07 · Linwei Zhai, Han Ding, Cui Zhao, Fei Wang, Ge Wang, Wang Zhi, Wei Xi

Neural audio codecs have recently gained traction for their ability to compress high-fidelity audio and generate discrete tokens that can be utilized in downstream generative modeling tasks. However, leading approaches often rely on resource-intensive models and multi-quantizer architectures, resulting in considerable computational overhead and constrained real-world applicability. In this paper, we present SQCodec, a lightweight neural audio codec that leverages a single quantizer to address these limitations. SQCodec explores streamlined convolutional networks and local Transformer modules, alongside TConv, a novel mechanism designed to capture acoustic variations across multiple temporal scales, thereby enhancing reconstruction fidelity while reducing model complexity. Extensive experiments across diverse datasets show that SQCodec achieves audio quality comparable to multi-quantizer baselines, while its single-quantizer design offers enhanced adaptability and its lightweight architecture reduces resource consumption by an order of magnitude. The source code is publicly available at https://github.com/zhai-lw/SQCodec.

📄 PDF Abstract BibTeX arXiv:2504.04949

Code (1)

zhai-lw/sqcodec 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Switchcodec: Adaptive residual-expert sparse quantization for high-fidelity neural audio coding

2026-01-28 · Xiangbo Wang, Wenbin Jiang, Jin Wang, Yubo You 외 arxiv

Recent neural audio compression models often rely on residual vector quantization for high-fidelity coding, but using a fixed number of per-frame codebooks is suboptimal for the wide variability of audio content-especial…

SNAC: Multi-Scale Neural Audio Codec

2024-10-18 · Hubert Siuzdak, Florian Grötschla, Luca A. Lanzendörfer

Neural audio codecs have recently gained popularity because they can represent audio signals with high fidelity at very low bitrates, making it feasible to use language modeling approaches for audio generation and unders…

Audio CompressionAudio GenerationLanguage ModelingLanguage Modelling+1

UniCodec: Unified Audio Codec with Single Domain-Adaptive Codebook

2025-02-27 · Yidi Jiang, Qian Chen, Shengpeng Ji, Yu Xi 외

The emergence of audio language models is empowered by neural audio codecs, which establish critical mappings between continuous waveforms and discrete tokens compatible with language model paradigms. The evolutionary tr…

Language ModelingLanguage ModellingMixture-of-Experts

APCodec+: A Spectrum-Coding-Based High-Fidelity and High-Compression-Rate Neural Audio Codec with Staged Training Paradigm

2024-10-30 · Hui-Peng Du, Yang Ai, Rui-Chen Zheng, Zhen-Hua Ling

This paper proposes a novel neural audio codec, named APCodec+, which is an improved version of APCodec. The APCodec+ takes the audio amplitude and phase spectra as the coding object, and employs an adversarial training …

DecoderQuantization

Efficient Evaluation of Quantization-Effects in Neural Codecs

2025-02-07 · Wolfgang Mack, Ahmed Mustafa, Rafał Łaganowski, Samer Hijazy

Neural codecs, comprising an encoder, quantizer, and decoder, enable signal transmission at exceptionally low bitrates. Training these systems requires techniques like the straight-through estimator, soft-to-hard anneali…

DecoderQuantization