Deep Pictorial Gaze Estimation
Estimating human gaze from natural eye images only is a challenging task. Gaze direction can be defined by the pupil- and the eyeball center where the latter is unobservable in 2D images. Hence, achieving highly accurate gaze estimates is an ill-posed problem. In this paper, we introduce a novel deep neural network architecture specifically designed for the task of gaze estimation from single eye input. Instead of directly regressing two angles for the pitch and yaw of the eyeball, we regress to an intermediate pictorial representation which in turn simplifies the task of 3D gaze direction estimation. Our quantitative and qualitative results show that our approach achieves higher accuracies than the state-of-the-art and is robust to variation in gaze, head pose and image quality.
Code (1)
Tasks
Gaze EstimationSimilar Papers 제목 키워드 기반
Coarse-to-Fine Gaze Redirection with Numerical and Pictorial Guidance
Gaze redirection aims at manipulating the gaze of a given face image with respect to a desired direction (i.e., a reference angle) and it can be applied to many real life scenarios, such as video-conferencing or taking g…
gaze redirectionImage Generation3D Pictorial Structures for Multiple View Articulated Pose Estimation
We consider the problem of automatically estimating the 3D pose of humans from images, taken from multiple calibrated views. We show that it is possible and tractable to extend the pictorial structures framework, popular…
2D Pose EstimationPose EstimationAnnotating shadows, highlights and faces: the contribution of a 'human in the loop' for digital art history
While automatic computational techniques appear to reveal novel insights in digital art history, a complementary approach seems to get less attention: that of human annotation. We argue and exemplify that a 'human in the…
Multiple human pose estimation with temporally consistent 3d pictorial structures
Multiple human 3D pose estimation from multiple camera views is a challenging task in unconstrained environments. Each individual has to be matched across each view and then the body pose has to be estimated. Additionall…
3D Multi-Person Pose Estimation3D Pose EstimationPose EstimationDiscovering Useful Parts for Pose Estimation in Sparsely Annotated Datasets
Our work introduces a novel way to increase pose estimation accuracy by discovering parts from unannotated regions of training images. Discovered parts are used to generate more accurate appearance likelihoods for tradit…
Pose Estimation