Segmented convolutional gated recurrent neural networks for human activity recognition in ultra-wideband radar
The automatic detection and recognition of human activities are valuable for physical security, gaming, and intelligent interface. Compared to an optical recognition system, radar is more robust to variations in lighting conditions and occlusions. The centimeter-wave ultra-wideband radar can even track human motion when the target is fully occluded from it. In this work, we propose a neural network architecture, namely segmented convolutional gated recurrent neural network (SCGRNN), to recognize human activities based on micro-Doppler spectrograms measured by the ultra-wideband radar. Unlike most existing approaches which treat the micro-Doppler spectrograms the same way as natural images, we extract segmented features of spectrograms via convolution operation and encode the feature maps along the time axis with gated recurrent units. Taking advantage of regularities in both the time and Doppler frequency domains in this way, our model can detect activities with arbitrary lengths. The experiments show that our method outperforms existing models in fine temporal resolution, noise robustness, and generalization performance. The radar system can thus recognize human behavior when visible light is blocked by opaque objects. Keywords: Micro-Doppler spectrograms, Human activity recognition, Deep learning, Convolutional neural network, Recurrent neural network
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionHuman Activity RecognitionRF-based Action RecognitionRF-based Pose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Recurrent Neural Network for Mobile Human Activity Recognition with High Throughput
In this paper, we propose a method of human activity recognition with high throughput from raw accelerometer data applying a deep recurrent neural network (DRNN), and investigate various architectures and its combination…
Activity RecognitionHuman Activity RecognitionViT-ReT: Vision and Recurrent Transformer Neural Networks for Human Activity Recognition in Videos
Human activity recognition is an emerging and important area in computer vision which seeks to determine the activity an individual or group of individuals are performing. The applications of this field ranges from gener…
Activity RecognitionActivity Recognition In VideosGesture RecognitionHuman Activity RecognitionHuman Activity Recognition Using Cascaded Dual Attention CNN and Bi-Directional GRU Framework
Vision-based human activity recognition has emerged as one of the essential research areas in video analytics domain. Over the last decade, numerous advanced deep learning algorithms have been introduced to recognize com…
Action RecognitionActivity RecognitionComputational EfficiencyHuman Activity RecognitionTemporal Attention-Gated Model for Robust Sequence Classification
Typical techniques for sequence classification are designed for well-segmented sequences which have been edited to remove noisy or irrelevant parts. Therefore, such methods cannot be easily applied on noisy sequences exp…
ClassificationGeneral ClassificationmodelSentiment AnalysisFullie and Wiselie: A Dual-Stream Recurrent Convolutional Attention Model for Activity Recognition
Multimodal features play a key role in wearable sensor based Human Activity Recognition (HAR). Selecting the most salient features adaptively is a promising way to maximize the effectiveness of multimodal sensor data. In…
Activity RecognitionHuman Activity Recognitionvalid