paper-with-me

Papers

Comparing Natural Language Processing Techniques for Alzheimer's Dementia Prediction in Spontaneous Speech

2020-06-12 · Thomas Searle, Zina Ibrahim, Richard Dobson

Alzheimer's Dementia (AD) is an incurable, debilitating, and progressive neurodegenerative condition that affects cognitive function. Early diagnosis is important as therapeutics can delay progression and give those diagnosed vital time. Developing models that analyse spontaneous speech could eventually provide an efficient diagnostic modality for earlier diagnosis of AD. The Alzheimer's Dementia Recognition through Spontaneous Speech task offers acoustically pre-processed and balanced datasets for the classification and prediction of AD and associated phenotypes through the modelling of spontaneous speech. We exclusively analyse the supplied textual transcripts of the spontaneous speech dataset, building and comparing performance across numerous models for the classification of AD vs controls and the prediction of Mental Mini State Exam scores. We rigorously train and evaluate Support Vector Machines (SVMs), Gradient Boosting Decision Trees (GBDT), and Conditional Random Fields (CRFs) alongside deep learning Transformer based models. We find our top performing models to be a simple Term Frequency-Inverse Document Frequency (TF-IDF) vectoriser as input into a SVM model and a pre-trained Transformer based model `DistilBERT' when used as an embedding layer into simple linear models. We demonstrate test set scores of 0.81-0.82 across classification metrics and a RMSE of 4.58.

📄 PDF Abstract BibTeX arXiv:2006.07358

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationDiagnosticGeneral Classification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Multi-Head Attention 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

To BERT or Not To BERT: Comparing Speech and Language-based Approaches for Alzheimer's Disease Detection

2020-07-26 · Aparna Balagopalan, Benjamin Eyre, Frank Rudzicz, Jekaterina Novikova

Research related to automatically detecting Alzheimer's disease (AD) is important, given the high prevalence of AD and the high cost of traditional methods. Since AD significantly affects the content and acoustics of spo…

Alzheimer's Disease Detection

Entity Extraction with Knowledge from Web Scale Corpora

2019-11-21 · Zeyi Wen, Zeyu Huang, Rui Zhang

Entity extraction is an important task in text mining and natural language processing. A popular method for entity extraction is by comparing substrings from free text against a dictionary of entities. In this paper, we …

Entity Extraction using GAN

Leveraging Social Determinants of Health in Alzheimer's Research Using LLM-Augmented Literature Mining and Knowledge Graphs

2024-10-04 · Tianqi Shang, Shu Yang, Weiqing He, Tianhua Zhai 외

Growing evidence suggests that social determinants of health (SDoH), a set of nonmedical factors, affect individuals' risks of developing Alzheimer's disease (AD) and related dementias. Nevertheless, the etiological mech…

Knowledge GraphsLanguage ModelingLanguage ModellingLarge Language Model+2

Alzheimer's Diagnosis and Generation-Based Chatbot Using Hierarchical Attention and Transformer

2022-10-11 · Park Jun Yeong, Shin Su Jong, Choi Chang Hwan, Lee Jung Jae 외

In this paper, we propose a natural language processing architecture that can handle tasks that previously required two models as one model. With a single model, we analyze the language patterns and conversational contex…

ChatbotDecoder

Alzheimer's Disease Detection from Spontaneous Speech and Text: A review

2023-07-19 · Vrindha M. K., Geethu V., Anurenjan P. R., Deepak S. 외

In the past decade, there has been a surge in research examining the use of voice and speech analysis as a means of detecting neurodegenerative diseases such as Alzheimer's. Many studies have shown that certain acoustic …

Alzheimer's DetectionAlzheimer's Disease DetectionArticlesFeature Engineering