Self-Supervised 3D Hand Pose Estimation Through Training by Fitting
We present a self-supervision method for 3D hand pose estimation from depth maps. We begin with a neural network initialized with synthesized data and fine-tune it on real but unlabelled depth maps by minimizing a set of data-fitting terms. By approximating the hand surface with a set of spheres, we design a differentiable hand renderer to align estimates by comparing the rendered and input depth maps. In addition, we place a set of priors including a data-driven term to further regulate the estimate's kinematic feasibility. Our method makes highly accurate estimates comparable to current supervised methods which require large amounts of labelled training samples, thereby advancing state-of-the-art in unsupervised learning for hand pose estimation.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Hand Pose EstimationHand Pose EstimationPose EstimationSimilar Papers 제목 키워드 기반
HandMIM: Pose-Aware Self-Supervised Learning for 3D Hand Mesh Estimation
With an enormous number of hand images generated over time, unleashing pose knowledge from unlabeled images for supervised hand mesh estimation is an emerging yet challenging topic. To alleviate this issue, semi-supervis…
Pose EstimationregressionRepresentation LearningSelf-Supervised LearningMambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimation
In the field of self-supervised depth estimation, Convolutional Neural Networks (CNNs) and Transformers have traditionally been dominant. However, both architectures struggle with efficiently handling long-range dependen…
DecoderDepth EstimationMambaMonocular Depth EstimationHaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learning
Recent advancements in 3D hand pose estimation have shown promising results, but its effectiveness has primarily relied on the availability of large-scale annotated datasets, the creation of which is a laborious and cost…
3D Hand Pose EstimationHand Pose EstimationPose EstimationSelf-Supervised LearningSelf-Supervised Monocular Visual Drone Model Identification through Improved Occlusion Handling
Ego-motion estimation is vital for drones when flying in GPS-denied environments. Vision-based methods struggle when flight speed increases and close-by objects lead to difficult visual conditions with considerable motio…
Motion EstimationOcclusion HandlingPose EstimationSelf-Supervised Learning+1SO-HandNet: Self-Organizing Network for 3D Hand Pose Estimation With Semi-Supervised Learning
3D hand pose estimation has made significant progress recently, where Convolutional Neural Networks (CNNs) play a critical role. However, most of the existing CNN-based hand pose estimation methods depend much on the tra…
3D Hand Pose EstimationDecoderHand Pose EstimationPose Estimation