Human Activity Recognition from Wearable Sensor Data Using Self-Attention
Human Activity Recognition from body-worn sensor data poses an inherent challenge in capturing spatial and temporal dependencies of time-series signals. In this regard, the existing recurrent or convolutional or their hybrid models for activity recognition struggle to capture spatio-temporal context from the feature space of sensor reading sequence. To address this complex problem, we propose a self-attention based neural network model that foregoes recurrent architectures and utilizes different types of attention mechanisms to generate higher dimensional feature representation used for classification. We performed extensive experiments on four popular publicly available HAR datasets: PAMAP2, Opportunity, Skoda and USC-HAD. Our model achieve significant performance improvement over recent state-of-the-art models in both benchmark test subjects and Leave-one-subject-out evaluation. We also observe that the sensor attention maps produced by our model is able capture the importance of the modality and placement of the sensors in predicting the different activity classes.
Code (2)
Tasks
Activity RecognitionHuman Activity RecognitionTime SeriesTime Series AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SALIENCE: An Unsupervised User Adaptation Model for Multiple Wearable Sensors Based Human Activity Recognition
Unsupervised user adaptation aligns the feature distributions of the data from training users and the new user, so a well-trained wearable human activity recognition (WHAR) model can be well adapted to the new user. With…
Activity RecognitionHuman Activity RecognitionHuman Activity Recognition Based on Wearable Sensor Data: A Standardization of the State-of-the-Art
Human activity recognition based on wearable sensor data has been an attractive research topic due to its application in areas such as healthcare and smart environments. In this context, many works have presented remarka…
Activity RecognitionHuman Activity Recognitionimage-classificationImage Classification+2Mukhtasir-Khail-Net: An Ultra-Efficient Convolutional Neural Network for Sports Activity Recognition with Wearable Inertial Sensors
The current prevalent approach of the Internet of Health and Medical Things entails proactively preventing disease onset through routine monitoring of individuals’ physical activities, making Human Activity Recognition (…
Activity RecognitionHuman Activity RecognitionSports Activity RecognitionDeep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Mobile and wearable devices have enabled numerous applications, including activity tracking, wellness monitoring, and human--computer interaction, that measure and improve our daily lives. Many of these applications are …
Activity RecognitionDeep LearningHuman Activity RecognitionVideo2IMU: Realistic IMU features and signals from videos
Human Activity Recognition (HAR) from wearable sensor data identifies movements or activities in unconstrained environments. HAR is a challenging problem as it presents great variability across subjects. Obtaining large …
Activity RecognitionHuman Activity Recognition