A Stutter Seldom Comes Alone -- Cross-Corpus Stuttering Detection as a Multi-label Problem
Most stuttering detection and classification research has viewed stuttering as a multi-class classification problem or a binary detection task for each dysfluency type; however, this does not match the nature of stuttering, in which one dysfluency seldom comes alone but rather co-occurs with others. This paper explores multi-language and cross-corpus end-to-end stuttering detection as a multi-label problem using a modified wav2vec 2.0 system with an attention-based classification head and multi-task learning. We evaluate the method using combinations of three datasets containing English and German stuttered speech, one containing speech modified by fluency shaping. The experimental results and an error analysis show that multi-label stuttering detection systems trained on cross-corpus and multi-language data achieve competitive results but performance on samples with multiple labels stays below over-all detection results.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationCross-corpusMulti-class ClassificationMulti-Task LearningSimilar Papers 제목 키워드 기반
Dysfluencies Seldom Come Alone -- Detection as a Multi-Label Problem
Specially adapted speech recognition models are necessary to handle stuttered speech. For these to be used in a targeted manner, stuttered speech must be reliably detected. Recent works have treated stuttering as a multi…
Multi-class Classificationspeech-recognitionSpeech RecognitionMultilingual Stutter Event Detection for English, German, and Mandarin Speech
This paper presents a multi-label stuttering detection system trained on multi-corpus, multilingual data in English, German, and Mandarin.By leveraging annotated stuttering data from three languages and four corpora, the…
Detecting Dysfluencies in Stuttering Therapy Using wav2vec 2.0
Stuttering is a varied speech disorder that harms an individual's communication ability. Persons who stutter (PWS) often use speech therapy to cope with their condition. Improving speech recognition systems for people wi…
Multi-Task Learningspeech-recognitionSpeech RecognitionSEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stutter
The ability to automatically detect stuttering events in speech could help speech pathologists track an individual's fluency over time or help improve speech recognition systems for people with atypical speech patterns. …
Event Detectionspeech-recognitionSpeech RecognitionYOLO-Stutter: End-to-end Region-Wise Speech Dysfluency Detection
Dysfluent speech detection is the bottleneck for disordered speech analysis and spoken language learning. Current state-of-the-art models are governed by rule-based systems which lack efficiency and robustness, and are s…