paper-with-me

홈 › Papers

DASB -- Discrete Audio and Speech Benchmark

2024-06-20 · Pooneh Mousavi, Luca Della Libera, Jarod Duret, Artem Ploujnikov, Cem Subakan, Mirco Ravanelli

Discrete audio tokens have recently gained considerable attention for their potential to connect audio and language processing, enabling the creation of modern multimodal large language models. Ideal audio tokens must effectively preserve phonetic and semantic content along with paralinguistic information, speaker identity, and other details. While several types of audio tokens have been recently proposed, identifying the optimal tokenizer for various tasks is challenging due to the inconsistent evaluation settings in existing studies. To address this gap, we release the Discrete Audio and Speech Benchmark (DASB), a comprehensive leaderboard for benchmarking discrete audio tokens across a wide range of discriminative tasks, including speech recognition, speaker identification and verification, emotion recognition, keyword spotting, and intent classification, as well as generative tasks such as speech enhancement, separation, and text-to-speech. Our results show that, on average, semantic tokens outperform compression tokens across most discriminative and generative tasks. However, the performance gap between semantic tokens and standard continuous representations remains substantial, highlighting the need for further research in this field.

📄 PDF Abstract BibTeX arXiv:2406.14294

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingEmotion Recognitionintent-classificationIntent ClassificationKeyword SpottingSpeaker IdentificationSpeech Enhancementspeech-recognitionSpeech Recognitiontext-to-speechText to Speech

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPT

2023-10-07 · Zhihao Du, JiaMing Wang, Qian Chen, Yunfei Chu 외

Generative Pre-trained Transformer (GPT) models have achieved remarkable performance on various natural language processing tasks, and have shown great potential as backbones for audio-and-text large language models (LLM…

Audio captioningAutomatic Speech RecognitionEmotion RecognitionLanguage Modelling+14

TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation

2023-12-23 · Xize Cheng, Rongjie Huang, Linjun Li, Tao Jin 외

Direct speech-to-speech translation achieves high-quality results through the introduction of discrete units obtained from self-supervised learning. This approach circumvents delays and cascading errors associated with m…

es-enfr-enSelf-Supervised LearningSpeech-to-Speech Translation+1

Discrete Audio Tokens: More Than a Survey!

2025-06-12 · Pooneh Mousavi, Gallil Maimon, Adel Moumen, Darius Petermann 외

Discrete audio tokens are compact representations that aim to preserve perceptual quality, phonetic content, and speaker characteristics while enabling efficient storage and inference, as well as competitive performance …

Language ModelingLanguage ModellingQuantizationSurvey

Low Bitrate High-Quality RVQGAN-based Discrete Speech Tokenizer

2024-10-10 · Slava Shechtman, Avihu Dekel

Discrete Audio codecs (or audio tokenizers) have recently regained interest due to the ability of Large Language Models (LLMs) to learn their compressed acoustic representations. Various publicly available trainable disc…

Whisper-GPT: A Hybrid Representation Audio Large Language Model

2024-12-16 · Prateek Verma

We propose WHISPER-GPT: A generative large language model (LLM) for speech and music that allows us to work with continuous audio representations and discrete tokens simultaneously as part of a single architecture. There…

Language ModelingLanguage ModellingLarge Language Model