paper-with-me

홈 › Papers

Event-based tracking of human hands

2023-04-13 · Laura Duarte, Mohammad Safeea, Pedro Neto

This paper proposes a novel method for human hands tracking using data from an event camera. The event camera detects changes in brightness, measuring motion, with low latency, no motion blur, low power consumption and high dynamic range. Captured frames are analysed using lightweight algorithms reporting 3D hand position data. The chosen pick-and-place scenario serves as an example input for collaborative human-robot interactions and in obstacle avoidance for human-robot safety applications. Events data are pre-processed into intensity frames. The regions of interest (ROI) are defined through object edge event activity, reducing noise. ROI features are extracted for use in-depth perception. Event-based tracking of human hand demonstrated feasible, in real time and at a low computational cost. The proposed ROI-finding method reduces noise from intensity images, achieving up to 89% of data reduction in relation to the original, while preserving the features. The depth estimation error in relation to ground truth (measured with wearables), measured using dynamic time warping and using a single event camera, is from 15 to 30 millimetres, depending on the plane it is measured. Tracking of human hands in 3D space using a single event camera data and lightweight algorithms to define ROI features (hands tracking in space).

📄 PDF Abstract BibTeX arXiv:2304.06534

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationDynamic Time WarpingRelation

Similar Papers 제목 키워드 기반

Differentiable Event Stream Simulator for Non-Rigid 3D Tracking

2021-04-30 · Jalees Nehvi, Vladislav Golyanik, Franziska Mueller, Hans-Peter Seidel 외

This paper introduces the first differentiable simulator of event streams, i.e., streams of asynchronous brightness change signals recorded by event cameras. Our differentiable simulator enables non-rigid 3D tracking of …

3D Pose Estimation of Two Interacting Hands from a Monocular Event Camera

2023-12-21 · Christen Millerdurai, Diogo Luvizon, Viktor Rudnev, André Jonas 외

3D hand tracking from a monocular video is a very challenging problem due to hand interactions, occlusions, left-right hand ambiguity, and fast motion. Most existing methods rely on RGB inputs, which have severe limitati…

3D Pose Estimation3D ReconstructionPose Estimation

HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction

2024-06-10 · Jikai Wang, Qifan Zhang, Yu-Wei Chao, Bowen Wen 외

We introduce a data capture system and a new dataset, HO-Cap, for 3D reconstruction and pose tracking of hands and objects in videos. The system leverages multiple RGB-D cameras and a HoloLens headset for data collection…

3D Reconstructionhand-object poseHand Pose EstimationPose Tracking+1

Tracking Fast by Learning Slow: An Event-based Speed Adaptive Hand Tracker Leveraging Knowledge in RGB Domain

2023-02-28 · Chuanlin Lan, Ziyuan Yin, Arindam Basu, Rosa H. M. Chan

3D hand tracking methods based on monocular RGB videos are easily affected by motion blur, while event camera, a sensor with high temporal resolution and dynamic range, is naturally suitable for this task with sparse out…

RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Video

2021-06-22 · Jiayi Wang, Franziska Mueller, Florian Bernard, Suzanne Sorli 외

Tracking and reconstructing the 3D pose and geometry of two hands in interaction is a challenging problem that has a high relevance for several human-computer interaction applications, including AR/VR, robotics, or sign …

3D ReconstructionSign Language Recognition