paper-with-me

Papers

Transformers for 1D Signals in Parkinson's Disease Detection from Gait

2022-04-01 · Duc Minh Dimitri Nguyen, Mehdi Miah, Guillaume-Alexandre Bilodeau, Wassim Bouachir

This paper focuses on the detection of Parkinson's disease based on the analysis of a patient's gait. The growing popularity and success of Transformer networks in natural language processing and image recognition motivated us to develop a novel method for this problem based on an automatic features extraction via Transformers. The use of Transformers in 1D signal is not really widespread yet, but we show in this paper that they are effective in extracting relevant features from 1D signals. As Transformers require a lot of memory, we decoupled temporal and spatial information to make the model smaller. Our architecture used temporal Transformers, dimension reduction layers to reduce the dimension of the data, a spatial Transformer, two fully connected layers and an output layer for the final prediction. Our model outperforms the current state-of-the-art algorithm with 95.2\% accuracy in distinguishing a Parkinsonian patient from a healthy one on the Physionet dataset. A key learning from this work is that Transformers allow for greater stability in results. The source code and pre-trained models are released in https://github.com/DucMinhDimitriNguyen/Transformers-for-1D-signals-in-Parkinson-s-disease-detection-from-gait.git

📄 PDF Abstract BibTeX arXiv:2204.00423

Code (1)

ducminhdimitringuyen/transformers-for-1d-signals-in-parkinson-s-disease-detection-from-gait 공식 구현

Tasks

Dimensionality Reduction

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Deep 1D-Convnet for accurate Parkinson disease detection and severity prediction from gait

2019-10-25 · Expert Systems with Applications 2020 4 · Imanne El Maachi, Guillaume-Alexandre Bilodeau, Wassim Bouachir

Diagnosing Parkinson's disease is a complex task that requires the evaluation of several motor and non-motor symptoms. During diagnosis, gait abnormalities are among the important symptoms that physicians should consider…

Gait Recognitionseverity prediction

1D-Convolutional transformer for Parkinson disease diagnosis from gait

2023-11-06 · Safwen Naimi, Wassim Bouachir, Guillaume-Alexandre Bilodeau

This paper presents an efficient deep neural network model for diagnosing Parkinson's disease from gait. More specifically, we introduce a hybrid ConvNet-Transformer architecture to accurately diagnose the disease by det…

HCT: Hybrid Convnet-Transformer for Parkinson's disease detection and severity prediction from gait

2023-10-26 · Safwen Naimi, Wassim Bouachir, Guillaume-Alexandre Bilodeau

In this paper, we propose a novel deep learning method based on a new Hybrid ConvNet-Transformer architecture to detect and stage Parkinson's disease (PD) from gait data. We adopt a two-step approach by dividing the prob…

severity prediction

Parkinson's Disease Diagnosis Through Deep Learning: A Novel LSTM-Based Approach for Freezing of Gait Detection

2024-12-09 · Aqib Nazir Mir, Iqra Nissar, Mumtaz Ahmed, Sarfaraz Masood 외

Deep learning holds tremendous potential in healthcare for uncovering hidden patterns within extensive clinical datasets, aiding in the diagnosis of various diseases. Parkinson's disease (PD) is a neurodegenerative condi…

Feature EngineeringL2 RegularizationSpecificity

Comparison of user models based on GMM-UBM and i-vectors for speech, handwriting, and gait assessment of Parkinson's disease patients

2020-02-13 · J. C. Vasquez-Correa, T. Bocklet, J. R. Orozco-Arroyave, E. Nöth

Parkinson's disease is a neurodegenerative disorder characterized by the presence of different motor impairments. Information from speech, handwriting, and gait signals have been considered to evaluate the neurological s…

Speaker Verification