Fingertip in the Eye: A cascaded CNN pipeline for the real-time fingertip detection in egocentric videos
We introduce a new pipeline for hand localization and fingertip detection. For RGB images captured from an egocentric vision mobile camera, hand and fingertip detection remains a challenging problem due to factors like background complexity and hand shape variety. To address these issues accurately and robustly, we build a large scale dataset named Ego-Fingertip and propose a bi-level cascaded pipeline of convolutional neural networks, namely, Attention-based Hand Detector as well as Multi-point Fingertip Detector. The proposed method significantly tackles challenges and achieves satisfactorily accurate prediction and real-time performance compared to previous hand and fingertip detection methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Fingertip DetectionSimilar Papers 제목 키워드 기반
Unified Learning Approach for Egocentric Hand Gesture Recognition and Fingertip Detection
Head-mounted device-based human-computer interaction often requires egocentric recognition of hand gestures and fingertips detection. In this paper, a unified approach of egocentric hand gesture recognition and fingertip…
Fingertip DetectionGesture RecognitionHand Gesture RecognitionPositionAnchors Based Method for Fingertips Position Estimation from a Monocular RGB Image using Deep Neural Network
In Virtual, augmented, and mixed reality, the use of hand gestures is increasingly becoming popular to reduce the difference between the virtual and real world. The precise location of the fingertip is essential/crucial …
Hand DetectionMixed RealityPositionTwo-stream convolutional neural network for accurate RGB-D fingertip detection using depth and edge information
Accurate detection of fingertips in depth image is critical for human-computer interaction. In this paper, we present a novel two-stream convolutional neural network (CNN) for RGB-D fingertip detection. Firstly edge imag…
Fingertip DetectionTipiano: Cascaded Piano Hand Motion Synthesis via Fingertip Priors
Synthesizing realistic piano hand motions requires both precision and naturalness. Physics-based methods achieve precision but produce stiff motions; data-driven models learn natural dynamics but struggle with positional…
Motion SynthesisHand Segmentation and Fingertip Tracking from Depth Camera Images Using Deep Convolutional Neural Network and Multi-task SegNet
Hand segmentation and fingertip detection play an indispensable role in hand gesture-based human-machine interaction systems. In this study, we propose a method to discriminate hand components and to locate fingertips in…
Fingertip DetectionHand DetectionHand SegmentationSegmentation