KAN-HyperpointNet for Point Cloud Sequence-Based 3D Human Action Recognition
Point cloud sequence-based 3D action recognition has achieved impressive performance and efficiency. However, existing point cloud sequence modeling methods cannot adequately balance the precision of limb micro-movements with the integrity of posture macro-structure, leading to the loss of crucial information cues in action inference. To overcome this limitation, we introduce D-Hyperpoint, a novel data type generated through a D-Hyperpoint Embedding module. D-Hyperpoint encapsulates both regional-momentary motion and global-static posture, effectively summarizing the unit human action at each moment. In addition, we present a D-Hyperpoint KANsMixer module, which is recursively applied to nested groupings of D-Hyperpoints to learn the action discrimination information and creatively integrates Kolmogorov-Arnold Networks (KAN) to enhance spatio-temporal interaction within D-Hyperpoints. Finally, we propose KAN-HyperpointNet, a spatio-temporal decoupled network architecture for 3D action recognition. Extensive experiments on two public datasets: MSR Action3D and NTU-RGB+D 60, demonstrate the state-of-the-art performance of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Action RecognitionAction RecognitionKolmogorov-Arnold NetworksTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Real-time 3D human action recognition based on Hyperpoint sequence
Real-time 3D human action recognition has broad industrial applications, such as surveillance, human-computer interaction, and healthcare monitoring. By relying on complex spatio-temporal local encoding, most existing po…
3D Action RecognitionAction RecognitionTemporal Action LocalizationSPiKE: 3D Human Pose from Point Cloud Sequences
3D Human Pose Estimation (HPE) is the task of locating keypoints of the human body in 3D space from 2D or 3D representations such as RGB images, depth maps or point clouds. Current HPE methods from depth and point clouds…
3D Human Pose EstimationPose EstimationTPU-GAN: Learning temporal coherence from dynamic point cloud sequences
Point cloud sequence is an important data representation that provides flexible shape and motion information. Prior work demonstrates that incorporating scene flow information into loss can make model learn temporally co…
Generative Adversarial Networkpoint cloud upsamplingSuper-ResolutionUST-SSM: Unified Spatio-Temporal State Space Models for Point Cloud Video Modeling
Point cloud videos capture dynamic 3D motion while reducing the effects of lighting and viewpoint variations, making them highly effective for recognizing subtle and continuous human actions. Although Selective State Spa…
A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences
Point cloud is one of the most widely used digital formats of 3D models, the visual quality of which is quite sensitive to distortions such as downsampling, noise, and compression. To tackle the challenge of point cloud …
Point Cloud Quality Assessment