paper-with-me

홈 › Papers

Spoken-Term Discovery using Discrete Speech Units

2024-08-26 · Benjamin van Niekerk, Julian Zaïdi, Marc-André Carbonneau, Herman Kamper

Discovering a lexicon from unlabeled audio is a longstanding challenge for zero-resource speech processing. One approach is to search for frequently occurring patterns in speech. We revisit this idea with DUSTED: Discrete Unit Spoken-TErm Discovery. Leveraging self-supervised models, we encode input audio into sequences of discrete units. Next, we find repeated patterns by searching for similar unit sub-sequences, inspired by alignment algorithms from bioinformatics. Since discretization discards speaker information, DUSTED finds better matches across speakers, improving the coverage and consistency of the discovered patterns. We demonstrate these improvements on the ZeroSpeech Challenge, achieving state-of-the-art results on the spoken-term discovery track. Finally, we analyze the duration distribution of the patterns, showing that our method finds longer word- or phrase-like terms.

📄 PDF Abstract BibTeX arXiv:2408.14390

Code (1)

bshall/dusted 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Improving Textless Spoken Language Understanding with Discrete Units as Intermediate Target

2023-05-29 · Guan-Wei Wu, Guan-Ting Lin, Shang-Wen Li, Hung-Yi Lee

Spoken Language Understanding (SLU) is a task that aims to extract semantic information from spoken utterances. Previous research has made progress in end-to-end SLU by using paired speech-text data, such as pre-trained …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Few-Shot Learningspeech-recognition+2

Unsupervised Term Discovery for Continuous Sign Language

2020-05-01 · LREC 2020 5 · Korhan Polat, Murat Sara{\c{c}}lar

Most of the sign language recognition (SLR) systems rely on supervision for training and available annotated sign language resources are scarce due to the difficulties of manual labeling. Unsupervised discovery of lexica…

Sign Language Recognition

Are discrete units necessary for Spoken Language Modeling?

2022-03-11 · Tu Anh Nguyen, Benoit Sagot, Emmanuel Dupoux

Recent work in spoken language modeling shows the possibility of learning a language unsupervisedly from raw audio without any text labels. The approach relies first on transforming the audio into a sequence of discrete …

Language ModelingLanguage Modelling

Unsupervised Spoken Term Discovery Based on Re-clustering of Hypothesized Speech Segments with Siamese and Triplet Networks

2020-11-28 · Man-Ling Sung, Tan Lee

Spoken term discovery from untranscribed speech audio could be achieved via a two-stage process. In the first stage, the unlabelled speech is decoded into a sequence of subword units that are learned and modelled in an u…

ClusteringTriplet

Analysing Discrete Self Supervised Speech Representation for Spoken Language Modeling

2023-01-02 · Amitay Sicherman, Yossi Adi

This work profoundly analyzes discrete self-supervised speech representations (units) through the eyes of Generative Spoken Language Modeling (GSLM). Following the findings of such an analysis, we propose practical impro…

Language ModelingLanguage ModellingResynthesis