Accurate Gaze Estimation using an Active-gaze Morphable Model
Rather than regressing gaze direction directly from images, we show that adding a 3D shape model can: i) improve gaze estimation accuracy, ii) perform well with lower resolution inputs and iii) provide a richer understanding of the eye-region and its constituent gaze system. Specifically, we use an eyes and nose' 3D morphable model (3DMM) to capture the eye-region 3D facial geometry and appearance and we equip this with a geometric vergence model of gaze to give an active-gaze 3DMM'. We show that our approach achieves state-of-the-art results on the Eyediap dataset and we present an ablation study. Our method can learn with only the ground truth gaze target point and the camera parameters, without access to the ground truth gaze origin points, thus widening the applicability of our approach compared to other methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Gaze EstimationSimilar Papers 제목 키워드 기반
Highly accurate gaze estimation using a consumer RGB-depth sensor
Determining the direction in which a person is looking is an important problem in a wide range of HCI applications. In this paper we describe a highly accurate algorithm that performs gaze estimation using an affordable …
Gaze EstimationHead Pose EstimationPose EstimationAn End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices
In recent years we have witnessed an increasing number of interactive systems on handheld mobile devices which utilise gaze as a single or complementary interaction modality. This trend is driven by the enhanced computat…
Deep LearningGaze EstimationDVGaze: Dual-View Gaze Estimation
Gaze estimation methods estimate gaze from facial appearance with a single camera. However, due to the limited view of a single camera, the captured facial appearance cannot provide complete facial information and thus c…
Gaze EstimationFree-HeadGAN: Neural Talking Head Synthesis with Explicit Gaze Control
We present Free-HeadGAN, a person-generic neural talking head synthesis system. We show that modeling faces with sparse 3D facial landmarks are sufficient for achieving state-of-the-art generative performance, without re…
Few-Shot LearningGaze EstimationFreeGaze: Resource-efficient Gaze Estimation via Frequency Domain Contrastive Learning
Gaze estimation is of great importance to many scientific fields and daily applications, ranging from fundamental research in cognitive psychology to attention-aware mobile systems. While recent advancements in deep lear…
Contrastive LearningGaze EstimationRepresentation Learning