paper-with-me

Papers

Wearable Sensor-Based Human Activity Recognition with Transformer Model

2022-03-01 · MDPI 2022 3 · Iveta Dirgová Luptáková, Martin Kubovčík, Jiří Pospíchal

Computing devices that can recognize various human activities or movements can be used to assist people in healthcare, sports, or human–robot interaction. Readily available data for this purpose can be obtained from the accelerometer and the gyroscope built into everyday smartphones. Effective classification of real-time activity data is, therefore, actively pursued using various machine learning methods. In this study, the transformer model, a deep learning neural network model developed primarily for the natural language processing and vision tasks, was adapted for a time-series analysis of motion signals. The self-attention mechanism inherent in the transformer, which expresses individual dependencies between signal values within a time series, can match the performance of state-of-the-art convolutional neural networks with long short-term memory. The performance of the proposed adapted transformer method was tested on the largest available public dataset of smartphone motion sensor data covering a wide range of activities, and obtained an average identification accuracy of 99.2% as compared with 89.67% achieved on the same data by a conventional machine learning method. The results suggest the expected future relevance of the transformer model for human activity recognition.

📄 PDF Abstract BibTeX

Code (1)

markub3327/HAR-Transformer tf

Tasks

Activity RecognitionHuman Activity RecognitionTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음

Similar Papers 제목 키워드 기반

TASKED: Transformer-based Adversarial learning for human activity recognition using wearable sensors via Self-KnowledgE Distillation

2022-09-14 · Sungho Suh, Vitor Fortes Rey, Paul Lukowicz

Wearable sensor-based human activity recognition (HAR) has emerged as a principal research area and is utilized in a variety of applications. Recently, deep learning-based methods have achieved significant improvement in…

Activity RecognitionHuman Activity RecognitionKnowledge DistillationSelf-Knowledge Distillation

SALIENCE: An Unsupervised User Adaptation Model for Multiple Wearable Sensors Based Human Activity Recognition

2021-08-17 · Ling Chen, Yi Zhang, Shenghuan Miao, Sirou Zhu 외

Unsupervised user adaptation aligns the feature distributions of the data from training users and the new user, so a well-trained wearable human activity recognition (WHAR) model can be well adapted to the new user. With…

Activity RecognitionHuman Activity Recognition

Human Activity Recognition Based on Wearable Sensor Data: A Standardization of the State-of-the-Art

2018-06-13 · Artur Jordao, Antonio C. Nazare Jr., Jessica Sena, William Robson Schwartz

Human activity recognition based on wearable sensor data has been an attractive research topic due to its application in areas such as healthcare and smart environments. In this context, many works have presented remarka…

Activity RecognitionHuman Activity Recognitionimage-classificationImage Classification+2

Mukhtasir-Khail-Net: An Ultra-Efficient Convolutional Neural Network for Sports Activity Recognition with Wearable Inertial Sensors

2024-10-22 · 4th International Conference on Digital Futures and Transformative Technologies (ICoDT2) 2024 10 · Hamza Ali Imran, Shaida Muhammad, Saad Wazir, Ataul Aziz Ikram

The current prevalent approach of the Internet of Health and Medical Things entails proactively preventing disease onset through routine monitoring of individuals’ physical activities, making Human Activity Recognition (…

Activity RecognitionHuman Activity RecognitionSports Activity Recognition

Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances

2021-10-31 · Shibo Zhang, Yaxuan Li, Shen Zhang, Farzad Shahabi 외

Mobile and wearable devices have enabled numerous applications, including activity tracking, wellness monitoring, and human--computer interaction, that measure and improve our daily lives. Many of these applications are …

Activity RecognitionDeep LearningHuman Activity Recognition