An Efficient PointLSTM for Point Clouds Based Gesture Recognition
Point clouds contain rich spatial information, which provides complementary cues for gesture recognition. In this paper, we formulate gesture recognition as an irregular sequence recognition problem and aim to capture long-term spatial correlations across point cloud sequences. A novel and effective PointLSTM is proposed to propagate information from past to future while preserving the spatial structure. The proposed PointLSTM combines state information from neighboring points in the past with current features to update the current states by a weight-shared LSTM layer. This method can be integrated into many other sequence learning approaches. In the task of gesture recognition, the proposed PointLSTM achieves state-of-the-art results on two challenging datasets (NVGesture and SHREC'17) and outperforms previous skeleton-based methods. To show its advantages in generalization, we evaluate our method on MSR Action3D dataset, and it produces competitive results with previous skeleton-based methods.
Code (1)
Tasks
Gesture RecognitionHand Gesture RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PointRNN: Point Recurrent Neural Network for Moving Point Cloud Processing
In this paper, we introduce a Point Recurrent Neural Network (PointRNN) for moving point cloud processing. At each time step, PointRNN takes point coordinates $\boldsymbol{P} \in \mathbb{R}^{n \times 3}$ and point featur…
Moving Point Cloud ProcessingDuodepth: Static Gesture Recognition Via Dual Depth Sensors
Static gesture recognition is an effective non-verbal communication channel between a user and their devices; however many modern methods are sensitive to the relative pose of the user's hands with respect to the capture…
General ClassificationGesture RecognitionTesla-Rapture: A Lightweight Gesture Recognition System from mmWave Radar Point Clouds
We present Tesla-Rapture, a gesture recognition interface for point clouds generated by mmWave Radars. State of the art gesture recognition models are either too resource consuming or not sufficiently accurate for integr…
Gesture RecognitionRaspberry Pi 4Spatiotemporal Learning of Dynamic Gestures from 3D Point Cloud Data
In this paper, we demonstrate an end-to-end spatiotemporal gesture learning approach for 3D point cloud data using a new gestures dataset of point clouds acquired from a 3D sensor. Nine classes of gestures were learned f…
Data AugmentationScene UnderstandingFusing Posture and Position Representations for Point Cloud-Based Hand Gesture Recognition
Hand gesture recognition can benefit from directly processing 3D point cloud sequences, which carry rich geometric information and enable the learning of expressive spatio-temporal features. However, currently employed s…
Gesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionPosition