Unconstrained Dysfluency Modeling for Dysfluent Speech Transcription and Detection
Dysfluent speech modeling requires time-accurate and silence-aware transcription at both the word-level and phonetic-level. However, current research in dysfluency modeling primarily focuses on either transcription or detection, and the performance of each aspect remains limited. In this work, we present an unconstrained dysfluency modeling (UDM) approach that addresses both transcription and detection in an automatic and hierarchical manner. UDM eliminates the need for extensive manual annotation by providing a comprehensive solution. Furthermore, we introduce a simulated dysfluent dataset called VCTK++ to enhance the capabilities of UDM in phonetic transcription. Our experimental results demonstrate the effectiveness and robustness of our proposed methods in both transcription and detection tasks.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Dysfluent WFST: A Framework for Zero-Shot Speech Dysfluency Transcription and Detection
Automatic detection of speech dysfluency aids speech-language pathologists in efficient transcription of disordered speech, enhancing diagnostics and treatment planning. Traditional methods, often limited to classificati…
DecoderTowards Hierarchical Spoken Language Dysfluency Modeling
Speech disfluency modeling is the bottleneck for both speech therapy and language learning. However, there is no effective AI solution to systematically tackle this problem. We solidify the concept of disfluent speech an…
Analysis and Evaluation of Synthetic Data Generation in Speech Dysfluency Detection
Speech dysfluency detection is crucial for clinical diagnosis and language assessment, but existing methods are limited by the scarcity of high-quality annotated data. Although recent advances in TTS model have enabled s…
DiversitySynthetic Data GenerationDeploying UDM Series in Real-Life Stuttered Speech Applications: A Clinical Evaluation Framework
Stuttered and dysfluent speech detection systems have traditionally suffered from the trade-off between accuracy and clinical interpretability. While end-to-end deep learning models achieve high performance, their black-…
SSDM: Scalable Speech Dysfluency Modeling
Speech dysfluency modeling is the core module for spoken language learning, and speech therapy. However, there are three challenges. First, current state-of-the-art solutions\cite{lian2023unconstrained-udm, lian-anumanch…