Fast and Robust Hand Tracking Using Detection-Guided Optimization
Markerless tracking of hands and fingers is a promising enabler for human-computer interaction. However, adoption has been limited because of tracking inaccuracies, incomplete coverage of motions, low framerate, complex camera setups, and high computational requirements. In this paper, we present a fast method for accurately tracking rapid and complex articulations of the hand using a single depth camera. Our algorithm uses a novel detection-guided optimization strategy that increases the robustness and speed of pose estimation. In the detection step, a randomized decision forest classifies pixels into parts of the hand. In the optimization step, a novel objective function combines the detected part labels and a Gaussian mixture representation of the depth to estimate a pose that best fits the depth. Our approach needs comparably less computational resources which makes it extremely fast (50 fps without GPU support). The approach also supports varying static, or moving, camera-to-scene arrangements. We show the benefits of our method by evaluating on public datasets and comparing against previous work.
Code (0)
등록된 구현이 없습니다.
Tasks
GPUPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Physics-Guided Fusion for Robust 3D Tracking of Fast Moving Small Objects
While computer vision has advanced considerably for general object detection and tracking, the specific problem of fast-moving tiny objects remains underexplored. This paper addresses the significant challenge of detecti…
Outlier DetectionObject DetectionRealtime and Robust Hand Tracking from Depth
We present a realtime hand tracking system using a depth sensor. It tracks a fully articulated hand under large viewpoints in realtime (25 FPS on a desktop without using a GPU) and with high accuracy (error below 10 mm).…
GPUStochastic OptimizationReal-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input
Real-time simultaneous tracking of hands manipulating and interacting with external objects has many potential applications in augmented reality, tangible computing, and wearable computing. However, due to difficult occl…
ObjectObject TrackingTemporally Guided Articulated Hand Pose Tracking in Surgical Videos
Articulated hand pose tracking is an under-explored problem that carries the potential for use in an extensive number of applications, especially in the medical domain. With a robust and accurate tracking system on in-vi…
Action RecognitionHand Pose EstimationMultiple Object TrackingObject Tracking+4Machine Learning based Pallets Detection and Tracking in AGVs
The use of automated guided vehicles (AGVs) has played a pivotal role in manufacturing and distribution operations, providing reliable and efficient product handling. In this project, we constructed a deep learning-based…
BIG-bench Machine LearningPosition