Robust Stuttering Detection via Multi-task and Adversarial Learning
By automatic detection and identification of stuttering, speech pathologists can track the progression of disfluencies of persons who stutter (PWS). In this paper, we investigate the impact of multi-task (MTL) and adversarial learning (ADV) to learn robust stutter features. This is the first-ever preliminary study where MTL and ADV have been employed in stuttering identification (SI). We evaluate our system on the SEP-28k stuttering dataset consisting of 20 hours (approx) of data from 385 podcasts. Our methods show promising results and outperform the baseline in various disfluency classes. We achieve up to 10%, 6.78%, and 2% improvement in repetitions, blocks, and interjections respectively over the baseline.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
An End-To-End Stuttering Detection Method Based On Conformer And BILSTM
Stuttering is a neurodevelopmental speech disorder characterized by common speech symptoms such as pauses, exclamations, repetition, and prolongation. Speech-language pathologists typically assess the type and severity o…
Event DetectionMulti-Task LearningA Stutter Seldom Comes Alone -- Cross-Corpus Stuttering Detection as a Multi-label Problem
Most stuttering detection and classification research has viewed stuttering as a multi-class classification problem or a binary detection task for each dysfluency type; however, this does not match the nature of stutteri…
ClassificationCross-corpusMulti-class ClassificationMulti-Task LearningMultilingual Stutter Event Detection for English, German, and Mandarin Speech
This paper presents a multi-label stuttering detection system trained on multi-corpus, multilingual data in English, German, and Mandarin.By leveraging annotated stuttering data from three languages and four corpora, the…
MMSD-Net: Towards Multi-modal Stuttering Detection
Stuttering is a common speech impediment that is caused by irregular disruptions in speech production, affecting over 70 million people across the world. Standard automatic speech processing tools do not take speech ailm…
Dysfluencies Seldom Come Alone -- Detection as a Multi-Label Problem
Specially adapted speech recognition models are necessary to handle stuttered speech. For these to be used in a targeted manner, stuttered speech must be reliably detected. Recent works have treated stuttering as a multi…
Multi-class Classificationspeech-recognitionSpeech Recognition