paper-with-me

Papers

Explainable Identification of Dementia from Transcripts using Transformer Networks

2021-09-14 · Loukas Ilias, Dimitris Askounis

Alzheimer's disease (AD) is the main cause of dementia which is accompanied by loss of memory and may lead to severe consequences in peoples' everyday life if not diagnosed on time. Very few works have exploited transformer-based networks and despite the high accuracy achieved, little work has been done in terms of model interpretability. In addition, although Mini-Mental State Exam (MMSE) scores are inextricably linked with the identification of dementia, research works face the task of dementia identification and the task of the prediction of MMSE scores as two separate tasks. In order to address these limitations, we employ several transformer-based models, with BERT achieving the highest accuracy accounting for 87.50%. Concurrently, we propose an interpretable method to detect AD patients based on siamese networks reaching accuracy up to 83.75%. Next, we introduce two multi-task learning models, where the main task refers to the identification of dementia (binary classification), while the auxiliary one corresponds to the identification of the severity of dementia (multiclass classification). Our model obtains accuracy equal to 86.25% on the detection of AD patients in the multi-task learning setting. Finally, we present some new methods to identify the linguistic patterns used by AD patients and non-AD ones, including text statistics, vocabulary uniqueness, word usage, correlations via a detailed linguistic analysis, and explainability techniques (LIME). Findings indicate significant differences in language between AD and non-AD patients.

📄 PDF Abstract BibTeX arXiv:2109.06980

Code (0)

등록된 구현이 없습니다.

Tasks

Binary ClassificationMulti-Task Learning

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Adam 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Mitigating Confounding in Speech-Based Dementia Detection through Weight Masking

2025-06-05 · Zhecheng Sheng, Xiruo Ding, Brian Hur, Changye Li 외

Deep transformer models have been used to detect linguistic anomalies in patient transcripts for early Alzheimer's disease (AD) screening. While pre-trained neural language models (LMs) fine-tuned on AD transcripts perfo…

Detecting Dementia from Speech and Transcripts using Transformers

2021-10-27 · Loukas Ilias, Dimitris Askounis, John Psarras

Alzheimer's disease (AD) constitutes a neurodegenerative disease with serious consequences to peoples' everyday lives, if it is not diagnosed early since there is no available cure. Alzheimer's is the most common cause o…

Electroencephalogram (EEG)

A Tale of Two Perplexities: Sensitivity of Neural Language Models to Lexical Retrieval Deficits in Dementia of the Alzheimer's Type

2020-05-07 · ACL 2020 6 · Trevor Cohen, Serguei Pakhomov

In recent years there has been a burgeoning interest in the use of computational methods to distinguish between elicited speech samples produced by patients with dementia, and those from healthy controls. The difference …

DiagnosticRetrievalSensitivity

Useful Blunders: Can Automated Speech Recognition Errors Improve Downstream Dementia Classification?

2024-01-10 · Changye Li, Weizhe Xu, Trevor Cohen, Serguei Pakhomov

\textbf{Objectives}: We aimed to investigate how errors from automatic speech recognition (ASR) systems affect dementia classification accuracy, specifically in the ``Cookie Theft'' picture description task. We aimed to …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Classificationspeech-recognition+1

Infusing Acoustic Pause Context into Text-Based Dementia Assessment

2024-08-27 · Franziska Braun, Sebastian P. Bayerl, Florian Hönig, Hartmut Lehfeld 외

Speech pauses, alongside content and structure, offer a valuable and non-invasive biomarker for detecting dementia. This work investigates the use of pause-enriched transcripts in transformer-based language models to dif…

Binary Classification