Alzheimer Disease Classification through ASR-based Transcriptions: Exploring the Impact of Punctuation and Pauses
Alzheimer's Disease (AD) is the world's leading neurodegenerative disease, which often results in communication difficulties. Analysing speech can serve as a diagnostic tool for identifying the condition. The recent ADReSS challenge provided a dataset for AD classification and highlighted the utility of manual transcriptions. In this study, we used the new state-of-the-art Automatic Speech Recognition (ASR) model Whisper to obtain the transcriptions, which also include automatic punctuation. The classification models achieved test accuracy scores of 0.854 and 0.833 combining the pretrained FastText word embeddings and recurrent neural networks on manual and ASR transcripts respectively. Additionally, we explored the influence of including pause information and punctuation in the transcriptions. We found that punctuation only yielded minor improvements in some cases, whereas pause encoding aided AD classification for both manual and ASR transcriptions across all approaches investigated.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)ClassificationDiagnosticspeech-recognitionSpeech RecognitionWord EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Combining Prosodic, Voice Quality and Lexical Features to Automatically Detect Alzheimer's Disease
Alzheimer's Disease (AD) is nowadays the most common form of dementia, and its automatic detection can help to identify symptoms at early stages, so that preventive actions can be carried out. Moreover, non-intrusive tec…
regressionLeveraging Deep Learning and Xception Architecture for High-Accuracy MRI Classification in Alzheimer Diagnosis
Exploring the application of deep learning technologies in the field of medical diagnostics, Magnetic Resonance Imaging (MRI) provides a unique perspective for observing and diagnosing complex neurodegenerative diseases …
Deep Learningimage-classificationImage ClassificationMRI classificationText Classification by Contrastive Learning and Cross-lingual Data Augmentation for Alzheimer's Disease Detection
Data scarcity is always a constraint on analyzing speech transcriptions for automatic Alzheimer{'}s disease (AD) detection, especially when the subjects are non-English speakers. To deal with this issue, this paper first…
Alzheimer's Disease DetectionContrastive LearningData Augmentationtext-classification+1Influence of ASR and Language Model on Alzheimer's Disease Detection
Alzheimer's Disease is the most common form of dementia. Automatic detection from speech could help to identify symptoms at early stages, so that preventive actions can be carried out. This research is a contribution to …
Alzheimer's Disease DetectionLanguage ModelingLanguage ModellingPrediction of Progression to Alzheimer's disease with Deep InfoMax
Arguably, unsupervised learning plays a crucial role in the majority of algorithms for processing brain imaging. A recently introduced unsupervised approach Deep InfoMax (DIM) is a promising tool for exploring brain stru…
General Classification