Egocentric View Hand Action Recognition by Leveraging Hand Surface and Hand Grasp Type
We introduce a multi-stage framework that uses mean curvature on a hand surface and focuses on learning interaction between hand and object by analyzing hand grasp type for hand action recognition in egocentric videos. The proposed method does not require 3D information of objects including 6D object poses which are difficult to annotate for learning an object's behavior while it interacts with hands. Instead, the framework synthesizes the mean curvature of the hand mesh model to encode the hand surface geometry in 3D space. Additionally, our method learns the hand grasp type which is highly correlated with the hand action. From our experiment, we notice that using hand grasp type and mean curvature of hand increases the performance of the hand action recognition.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionObjectVocal Bursts Type PredictionSimilar Papers 제목 키워드 기반
Transformer-based Action recognition in hand-object interacting scenarios
This report describes the 2nd place solution to the ECCV 2022 Human Body, Hands, and Activities (HBHA) from Egocentric and Multi-view Cameras Challenge: Action Recognition. This challenge aims to recognize hand-object in…
Action RecognitionObjectBenchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects
We interact with the world with our hands and see it through our own (egocentric) perspective. A holistic 3Dunderstanding of such interactions from egocentric views is important for tasks in robotics, AR/VR, action recog…
Action RecognitionMotion GenerationObjectObject Reconstruction+1Trajectory Aligned Features For First Person Action Recognition
Egocentric videos are characterised by their ability to have the first person view. With the popularity of Google Glass and GoPro, use of egocentric videos is on the rise. Recognizing action of the wearer from egocentric…
Action RecognitionPoint TrackingTemporal Action LocalizationEgocentric Pose Recognition in Four Lines of Code
We tackle the problem of estimating the 3D pose of an individual's upper limbs (arms+hands) from a chest mounted depth-camera. Importantly, we consider pose estimation during everyday interactions with objects. Past work…
Pose EstimationFirst-Person Pose Recognition Using Egocentric Workspaces
We tackle the problem of estimating the 3D pose of an individual's upper limbs (arms+hands) from a chest mounted depth-camera. Importantly, we consider pose estimation during everyday interactions with objects. Past work…
Pose Estimation