Understanding and Improving Recurrent Networks for Human Activity Recognition by Continuous Attention
Deep neural networks, including recurrent networks, have been successfully applied to human activity recognition. Unfortunately, the final representation learned by recurrent networks might encode some noise (irrelevant signal components, unimportant sensor modalities, etc.). Besides, it is difficult to interpret the recurrent networks to gain insight into the models' behavior. To address these issues, we propose two attention models for human activity recognition: temporal attention and sensor attention. These two mechanisms adaptively focus on important signals and sensor modalities. To further improve the understandability and mean F1 score, we add continuity constraints, considering that continuous sensor signals are more robust than discrete ones. We evaluate the approaches on three datasets and obtain state-of-the-art results. Furthermore, qualitative analysis shows that the attention learned by the models agree well with human intuition.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionHuman Activity RecognitionSimilar Papers 제목 키워드 기반
Entropy Decision Fusion for Smartphone Sensor based Human Activity Recognition
Human activity recognition serves an important part in building continuous behavioral monitoring systems, which are deployable for visual surveillance, patient rehabilitation, gaming, and even personally inclined smart h…
Activity RecognitionHuman Activity RecognitionViT-ReT: Vision and Recurrent Transformer Neural Networks for Human Activity Recognition in Videos
Human activity recognition is an emerging and important area in computer vision which seeks to determine the activity an individual or group of individuals are performing. The applications of this field ranges from gener…
Activity RecognitionActivity Recognition In VideosGesture RecognitionHuman Activity RecognitionHuman Activity Recognition using Recurrent Neural Networks
Human activity recognition using smart home sensors is one of the bases of ubiquitous computing in smart environments and a topic undergoing intense research in the field of ambient assisted living. The increasingly larg…
Activity RecognitionBIG-bench Machine LearningHuman Activity RecognitionDeep Recurrent Neural Network for Mobile Human Activity Recognition with High Throughput
In this paper, we propose a method of human activity recognition with high throughput from raw accelerometer data applying a deep recurrent neural network (DRNN), and investigate various architectures and its combination…
Activity RecognitionHuman Activity RecognitionFullie and Wiselie: A Dual-Stream Recurrent Convolutional Attention Model for Activity Recognition
Multimodal features play a key role in wearable sensor based Human Activity Recognition (HAR). Selecting the most salient features adaptively is a promising way to maximize the effectiveness of multimodal sensor data. In…
Activity RecognitionHuman Activity Recognitionvalid