MediaPipe Hands: On-device Real-time Hand Tracking
We present a real-time on-device hand tracking pipeline that predicts hand skeleton from single RGB camera for AR/VR applications. The pipeline consists of two models: 1) a palm detector, 2) a hand landmark model. It's implemented via MediaPipe, a framework for building cross-platform ML solutions. The proposed model and pipeline architecture demonstrates real-time inference speed on mobile GPUs and high prediction quality. MediaPipe Hands is open sourced at https://mediapipe.dev.
Code (4)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
On-device Real-time Hand Gesture Recognition
We present an on-device real-time hand gesture recognition (HGR) system, which detects a set of predefined static gestures from a single RGB camera. The system consists of two parts: a hand skeleton tracker and a gesture…
Gesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionRobustness Evaluation in Hand Pose Estimation Models using Metamorphic Testing
Hand pose estimation (HPE) is a task that predicts and describes the hand poses from images or video frames. When HPE models estimate hand poses captured in a laboratory or under controlled environments, they normally de…
Hand Pose EstimationPose EstimationEnhancing Sign Language Detection through Mediapipe and Convolutional Neural Networks (CNN)
This research combines MediaPipe and CNNs for the efficient and accurate interpretation of ASL dataset for the real-time detection of sign language. The system presented here captures and processes hands' gestures in rea…
Gesture RecognitionPen Spinning Hand Movement Analysis Using MediaPipe Hands
We challenged to get data about hand movement in pen spinning using MediaPipe Hands and OpenCV. The purpose is to create a system that can be used to objectively evaluate the performance of pen spinning competitions. Eva…
Real-time Bangla Sign Language Translator
The human body communicates through various meaningful gestures, with sign language using hands being a prominent example. Bangla Sign Language Translation (BSLT) aims to bridge communication gaps for the deaf and mute c…
Sign Language TranslationTranslation