paper-with-me

Papers

A Comprehensive Rubric for Annotating Pathological Speech

2024-04-29 · Mario Corrales-Astorgano, David Escudero-Mancebo, Lourdes Aguilar, Valle Flores-Lucas, Valentín Cardeñoso-Payo, Carlos Vivaracho-Pascual, César González-Ferreras

Rubrics are a commonly used tool for labeling voice corpora in speech quality assessment, although their application in the context of pathological speech remains relatively limited. In this study, we introduce a comprehensive rubric based on various dimensions of speech quality, including phonetics, fluency, and prosody. The objective is to establish standardized criteria for identifying errors within the speech of individuals with Down syndrome, thereby enabling the development of automated assessment systems. To achieve this objective, we utilized the Prautocal corpus. To assess the quality of annotations using our rubric, two experiments were conducted, focusing on phonetics and fluency. For phonetic evaluation, we employed the Goodness of Pronunciation (GoP) metric, utilizing automatic segmentation systems and correlating the results with evaluations conducted by a specialized speech therapist. While the obtained correlation values were not notably high, a positive trend was observed. In terms of fluency assessment, deep learning models like wav2vec were used to extract audio features, and we employed an SVM classifier trained on a corpus focused on identifying fluency issues to categorize Prautocal corpus samples. The outcomes highlight the complexities of evaluating such phenomena, with variability depending on the specific type of disfluency detected.

📄 PDF Abstract BibTeX arXiv:2404.18851

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

Similar Papers 제목 키워드 기반

Deep Learning for Pathological Speech: A Survey

2025-01-07 · Shakeel A. Sheikh, Md. Sahidullah, Ina Kodrasi

Advancements in spoken language technologies for neurodegenerative speech disorders are crucial for meeting both clinical and technological needs. This overview paper is vital for advancing the field, as it presents a co…

Automatic Speech RecognitionData AugmentationDeep Learningspeech-recognition+2

The effect of speech pathology on automatic speaker verification -- a large-scale study

2022-04-13 · Soroosh Tayebi Arasteh, Tobias Weise, Maria Schuster, Elmar Noeth 외

Navigating the challenges of data-driven speech processing, one of the primary hurdles is accessing reliable pathological speech data. While public datasets appear to offer solutions, they come with inherent risks of pot…

Speaker VerificationText-Independent Speaker Verification

RIFT: A RubrIc Failure Mode Taxonomy and Automated Diagnostics

2026-04-01 · Zhengyang Qi, Charles Dickens, Derek Pham, Amanda Dsouza 외 arxiv

Rubric-based evaluation is widely used in LLM benchmarks and training pipelines for open-ended, less verifiable tasks. While prior work has demonstrated the effectiveness of rubrics using downstream signals such as reinf…

Reinforcement LearningInstruction FollowingCode Generation

Impact of Speech Mode in Automatic Pathological Speech Detection

2024-06-14 · Shakeel A. Sheikh, Ina Kodrasi

Automatic pathological speech detection approaches yield promising results in identifying various pathologies. These approaches are typically designed and evaluated for phonetically-controlled speech scenarios, where spe…

Navigate

V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning

2026-08-26 · Shulin Tian, Minglun Li, Yuhao Dong, Hao Ding 외 arxiv

Vision-language models can produce fluent answers that are insufficiently grounded in the visual evidence: a single unsupported object, chart value, or intermediate inference can undermine an otherwise plausible response…

Reinforcement LearningInstruction Following