paper-with-me

홈 › Papers

Latent Granular Resynthesis using Neural Audio Codecs

2025-07-25 · Nao Tokui, Tom Baker arxiv

We introduce a novel technique for creative audio resynthesis that operates by reworking the concept of granular synthesis at the latent vector level. Our approach creates a "granular codebook" by encoding a source audio corpus into latent vector segments, then matches each latent grain of a target audio signal to its closest counterpart in the codebook. The resulting hybrid sequence is decoded to produce audio that preserves the target's temporal structure while adopting the source's timbral characteristics. This technique requires no model training, works with diverse audio materials, and naturally avoids the discontinuities typical of traditional concatenative synthesis through the codec's implicit interpolation during decoding. We include supplementary material at https://github.com/naotokui/latentgranular/ , as well as a proof-of-concept implementation to allow users to experiment with their own sounds at https://huggingface.co/spaces/naotokui/latentgranular .

📄 PDF Abstract BibTeX arXiv:2507.19202

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Closer Look at Neural Codec Resynthesis: Bridging the Gap between Codec and Waveform Generation

2024-10-29 · Alexander H. Liu, Qirui Wang, Yuan Gong, James Glass

Neural Audio Codecs, initially designed as a compression technique, have gained more attention recently for speech generation. Codec models represent each audio frame as a sequence of tokens, i.e., discrete embeddings. T…

Resynthesis

Learning Source Disentanglement in Neural Audio Codec

2024-09-17 · Xiaoyu Bie, Xubo Liu, Gaël Richard

Neural audio codecs have significantly advanced audio compression by efficiently converting continuous audio signals into discrete tokens. These codecs preserve high-quality sound and enable sophisticated sound generatio…

Audio CompressionAudio GenerationDisentanglementResynthesis

Geometric Iterative Retrieval for Neural Audio Codec Resynthesis

2026-08-19 · Leo Schmidt-Traub, Frédéric Berdoz, Luca A. Lanzendörfer, Roger Wattenhofer arxiv

Neural audio codecs based on Residual Vector Quantization (RVQ) have become the dominant discrete representation for token-based general audio generation, yet resynthesizing high-quality audio from coarse codec tokens re…

Audio Generation

Beyond Fixed Frames: Dynamic Character-Aligned Speech Tokenization

2026-01-30 · Luca Della Libera, Cem Subakan, Mirco Ravanelli arxiv

Neural audio codecs are at the core of modern conversational speech technologies, converting continuous speech into sequences of discrete tokens that can be processed by LLMs. However, existing codecs typically operate a…

Analysing the Language of Neural Audio Codecs

2025-09-01 · Joonyong Park, Shinnosuke Takamichi, David M. Chan, Shunsuke Kando 외 arxiv

This study presents a comparative analysis of the statistical and linguistic properties of neural audio codecs (NACs). We investigate discrete speech tokens produced by various NAC models, examining their adherence to li…

Speech Recognition