Joint Hand Detection and Rotation Estimation by Using CNN
Hand detection is essential for many hand related tasks, e.g. parsing hand pose, understanding gesture, which are extremely useful for robotics and human-computer interaction. However, hand detection in uncontrolled environments is challenging due to the flexibility of wrist joint and cluttered background. We propose a deep learning based approach which detects hands and calibrates in-plane rotation under supervision at the same time. To guarantee the recall, we propose a context aware proposal generation algorithm which significantly outperforms the selective search. We then design a convolutional neural network(CNN) which handles object rotation explicitly to jointly solve the object detection and rotation estimation tasks. Experiments show that our method achieves better results than state-of-the-art detection models on widely-used benchmarks such as Oxford and Egohands database. We further show that rotation estimation and classification can mutually benefit each other.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationHand Detectionobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimation
Whole-body 3D human mesh estimation aims to reconstruct the 3D human body, hands, and face simultaneously. Although several methods have been proposed, accurate prediction of 3D hands, which consist of 3D wrist and finge…
3D Hand Pose Estimation3D Human Pose Estimation3D Human ReconstructionHand Pose Estimation+2D3L: Decomposition of 3D Rotation and Lift from 2D Joint to 3D for Human Mesh Recovery
Existing methods for 3D human mesh recovery always directly estimate SMPL parameters, which involve both joint rotations and shape parameters. However, these methods present rotation semantic ambiguity, rotation error ac…
Human Mesh RecoveryPose EstimationPositionNOMA Joint Channel Estimation and Signal Detection using Rotational Invariant Codes and GMM-based Clustering
This paper studies the joint channel estimation and signal detection for the uplink power-domain non-orthogonal multiple access. The proposed technique performs both detection and estimation without the need of pilot sym…
ClusteringMonocular Real-time Hand Shape and Motion Capture using Multi-modal Data
We present a novel method for monocular hand shape and pose estimation at unprecedented runtime performance of 100fps and at state-of-the-art accuracy. This is enabled by a new learning based architecture designed such t…
Pose EstimationLightweight Estimation of Hand Mesh and Biomechanically Feasible Kinematic Parameters
3D hand pose estimation is a long-standing challenge in both robotics and computer vision communities due to its implicit depth ambiguity and often strong self-occlusion. Recently, in addition to the hand skeleton, joint…
3D Hand Pose EstimationHand Pose EstimationPose Estimation