Dementia Assessment Using Mandarin Speech with an Attention-based Speech Recognition Encoder
Dementia diagnosis requires a series of different testing methods, which is complex and time-consuming. Early detection of dementia is crucial as it can prevent further deterioration of the condition. This paper utilizes a speech recognition model to construct a dementia assessment system tailored for Mandarin speakers during the picture description task. By training an attention-based speech recognition model on voice data closely resembling real-world scenarios, we have significantly enhanced the model's recognition capabilities. Subsequently, we extracted the encoder from the speech recognition model and added a linear layer for dementia assessment. We collected Mandarin speech data from 99 subjects and acquired their clinical assessments from a local hospital. We achieved an accuracy of 92.04% in Alzheimer's disease detection and a mean absolute error of 9% in clinical dementia rating score prediction.
Code (1)
Tasks
Alzheimer's Disease Detectionspeech-recognitionSpeech RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Infusing Acoustic Pause Context into Text-Based Dementia Assessment
Speech pauses, alongside content and structure, offer a valuable and non-invasive biomarker for detecting dementia. This work investigates the use of pause-enriched transcripts in transformer-based language models to dif…
Binary ClassificationDetecting dementia in Mandarin Chinese using transfer learning from a parallel corpus
Machine learning has shown promise for automatic detection of Alzheimer's disease (AD) through speech; however, efforts are hampered by a scarcity of data, especially in languages other than English. We propose a method …
BIG-bench Machine LearningMachine TranslationTransfer LearningTranslationA Multimodal Framework for Dementia Detection via Linguistic and Acoustic Representation Learning
Alzheimer's disease (AD) is a progressive neurodegenerative disorder and the leading cause of dementia, affecting memory, reasoning, communication, and daily functioning. Early diagnosis is particularly important, as tim…
Multimodal Deep LearningRepresentation LearningTemporal-Aware Iterative Speech Model for Dementia Detection
Deep learning systems often struggle with processing long sequences, where computational complexity can become a bottleneck. Current methods for automated dementia detection using speech frequently rely on static, time-a…
A comparable study of modeling units for end-to-end Mandarin speech recognition
End-To-End speech recognition have become increasingly popular in mandarin speech recognition and achieved delightful performance. Mandarin is a tonal language which is different from English and requires special treat…
Decoderspeech-recognitionSpeech Recognition