Local Spherical Harmonics Improve Skeleton-Based Hand Action Recognition
Hand action recognition is essential. Communication, human-robot interactions, and gesture control are dependent on it. Skeleton-based action recognition traditionally includes hands, which belong to the classes which remain challenging to correctly recognize to date. We propose a method specifically designed for hand action recognition which uses relative angular embeddings and local Spherical Harmonics to create novel hand representations. The use of Spherical Harmonics creates rotation-invariant representations which make hand action recognition even more robust against inter-subject differences and viewpoint changes. We conduct extensive experiments on the hand joints in the First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations, and on the NTU RGB+D 120 dataset, demonstrating the benefit of using Local Spherical Harmonics Representations. Our code is available at https://github.com/KathPra/LSHR_LSHT.
Code (1)
Tasks
Action RecognitionSkeleton Based Action RecognitionSimilar Papers 제목 키워드 기반
Acoustic source localization in the spherical harmonics domain exploiting low-rank approximations
Acoustic signal processing in the spherical harmonics domain (SHD) is an active research area that exploits the signals acquired by higher order microphone arrays. A very important task is that concerning the localizatio…
Spin-Weighted Spherical Harmonics for Polarized Light Transport
The objective of polarization rendering is to simulate the interaction of light with materials exhibiting polarization-dependent behavior. However, integrating polarization into rendering is challenging and increases com…
Global Earth Magnetic Field Modeling and Forecasting with Spherical Harmonics Decomposition
Modeling and forecasting the solar wind-driven global magnetic field perturbations is an open challenge. Current approaches depend on simulations of computationally demanding models like the Magnetohydrodynamics (MHD) mo…
Feature EngineeringAdaptive area-preserving parameterization of open and closed anatomical surfaces
The parameterization of open and closed anatomical surfaces is of fundamental importance in many biomedical applications. Spherical harmonics, a set of basis functions defined on the unit sphere, are widely used for anat…
ObjectSG-Splatting: Accelerating 3D Gaussian Splatting with Spherical Gaussians
3D Gaussian Splatting is emerging as a state-of-the-art technique in novel view synthesis, recognized for its impressive balance between visual quality, speed, and rendering efficiency. However, reliance on third-degree …
Computational EfficiencyNovel View Synthesis