Whose hand is this? Person Identification from Egocentric Hand Gestures
Recognizing people by faces and other biometrics has been extensively studied in computer vision. But these techniques do not work for identifying the wearer of an egocentric (first-person) camera because that person rarely (if ever) appears in their own first-person view. But while one's own face is not frequently visible, their hands are: in fact, hands are among the most common objects in one's own field of view. It is thus natural to ask whether the appearance and motion patterns of people's hands are distinctive enough to recognize them. In this paper, we systematically study the possibility of Egocentric Hand Identification (EHI) with unconstrained egocentric hand gestures. We explore several different visual cues, including color, shape, skin texture, and depth maps to identify users' hands. Extensive ablation experiments are conducted to analyze the properties of hands that are most distinctive. Finally, we show that EHI can improve generalization of other tasks, such as gesture recognition, by training adversarially to encourage these models to ignore differences between users.
Code (0)
등록된 구현이 없습니다.
Tasks
Gesture RecognitionPerson IdentificationSimilar Papers 제목 키워드 기반
First-Person Pose Recognition Using Egocentric Workspaces
We tackle the problem of estimating the 3D pose of an individual's upper limbs (arms+hands) from a chest mounted depth-camera. Importantly, we consider pose estimation during everyday interactions with objects. Past work…
Pose EstimationPerson Identification from Egocentric Human-Object Interactions using 3D Hand Pose
Human-Object Interaction Recognition (HOIR) and user identification play a crucial role in advancing augmented reality (AR)-based personalized assistive technologies. These systems are increasingly being deployed in high…
Person IdentificationTrajectory Aligned Features For First Person Action Recognition
Egocentric videos are characterised by their ability to have the first person view. With the popularity of Google Glass and GoPro, use of egocentric videos is on the rise. Recognizing action of the wearer from egocentric…
Action RecognitionPoint TrackingTemporal Action LocalizationEgocentric Hand Track and Object-based Human Action Recognition
Egocentric vision is an emerging field of computer vision that is characterized by the acquisition of images and video from the first person perspective. In this paper we address the challenge of egocentric human action …
Action RecognitionObjectobject-detectionObject Detection+1Left/Right Hand Segmentation in Egocentric Videos
Wearable cameras allow people to record their daily activities from a user-centered (First Person Vision) perspective. Due to their favorable location, wearable cameras frequently capture the hands of the user, and may t…
Hand SegmentationSegmentationSuperpixels