Self-supervised Optimization of Hand Pose Estimation using Anatomical Features and Iterative Learning
Manual assembly workers face increasing complexity in their work. Human-centered assistance systems could help, but object recognition as an enabling technology hinders sophisticated human-centered design of these systems. At the same time, activity recognition based on hand poses suffers from poor pose estimation in complex usage scenarios, such as wearing gloves. This paper presents a self-supervised pipeline for adapting hand pose estimation to specific use cases with minimal human interaction. This enables cheap and robust hand posebased activity recognition. The pipeline consists of a general machine learning model for hand pose estimation trained on a generalized dataset, spatial and temporal filtering to account for anatomical constraints of the hand, and a retraining step to improve the model. Different parameter combinations are evaluated on a publicly available and annotated dataset. The best parameter and model combination is then applied to unlabelled videos from a manual assembly scenario. The effectiveness of the pipeline is demonstrated by training an activity recognition as a downstream task in the manual assembly scenario.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionHand Pose EstimationObject RecognitionPose EstimationSimilar Papers 제목 키워드 기반
HandMIM: Pose-Aware Self-Supervised Learning for 3D Hand Mesh Estimation
With an enormous number of hand images generated over time, unleashing pose knowledge from unlabeled images for supervised hand mesh estimation is an emerging yet challenging topic. To alleviate this issue, semi-supervis…
Pose EstimationregressionRepresentation LearningSelf-Supervised LearningHaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learning
Recent advancements in 3D hand pose estimation have shown promising results, but its effectiveness has primarily relied on the availability of large-scale annotated datasets, the creation of which is a laborious and cost…
3D Hand Pose EstimationHand Pose EstimationPose EstimationSelf-Supervised LearningSO-HandNet: Self-Organizing Network for 3D Hand Pose Estimation With Semi-Supervised Learning
3D hand pose estimation has made significant progress recently, where Convolutional Neural Networks (CNNs) play a critical role. However, most of the existing CNN-based hand pose estimation methods depend much on the tra…
3D Hand Pose EstimationDecoderHand Pose EstimationPose EstimationSelf-Supervised 3D Hand Pose Estimation Through Training by Fitting
We present a self-supervision method for 3D hand pose estimation from depth maps. We begin with a neural network initialized with synthesized data and fine-tune it on real but unlabelled depth maps by minimizing a set of…
3D Hand Pose EstimationHand Pose EstimationPose EstimationSelf-Supervised Multi-Scale Network for Blind Image Deblurring via Alternating Optimization
Blind image deblurring is a challenging low-level vision task that involves estimating the unblurred image when the blur kernel is unknown. In this paper, we present a self-supervised multi-scale blind image deblurring m…
Blind Image DeblurringDeblurringImage Deblurring