paper-with-me

홈 › Papers

Accurate Gaze Estimation using an Active-gaze Morphable Model

2023-01-30 · Hao Sun, Nick Pears

Rather than regressing gaze direction directly from images, we show that adding a 3D shape model can: i) improve gaze estimation accuracy, ii) perform well with lower resolution inputs and iii) provide a richer understanding of the eye-region and its constituent gaze system. Specifically, we use an eyes and nose' 3D morphable model (3DMM) to capture the eye-region 3D facial geometry and appearance and we equip this with a geometric vergence model of gaze to give an active-gaze 3DMM'. We show that our approach achieves state-of-the-art results on the Eyediap dataset and we present an ablation study. Our method can learn with only the ground truth gaze target point and the camera parameters, without access to the ground truth gaze origin points, thus widening the applicability of our approach compared to other methods.

📄 PDF Abstract BibTeX arXiv:2301.13186

Code (0)

등록된 구현이 없습니다.

Tasks

Gaze Estimation

Similar Papers 제목 키워드 기반

Highly accurate gaze estimation using a consumer RGB-depth sensor

2016-04-05 · Reza Shoja Ghiass, Ognjen Arandjelovic

Determining the direction in which a person is looking is an important problem in a wide range of HCI applications. In this paper we describe a highly accurate algorithm that performs gaze estimation using an affordable …

Gaze EstimationHead Pose EstimationPose Estimation

An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices

2023-06-30 · Yaxiong Lei, Shijing He, Mohamed Khamis, Juan Ye

In recent years we have witnessed an increasing number of interactive systems on handheld mobile devices which utilise gaze as a single or complementary interaction modality. This trend is driven by the enhanced computat…

Deep LearningGaze Estimation

DVGaze: Dual-View Gaze Estimation

2023-08-20 · ICCV 2023 1 · Yihua Cheng, Feng Lu

Gaze estimation methods estimate gaze from facial appearance with a single camera. However, due to the limited view of a single camera, the captured facial appearance cannot provide complete facial information and thus c…

Gaze Estimation

Free-HeadGAN: Neural Talking Head Synthesis with Explicit Gaze Control

2022-08-03 · Michail Christos Doukas, Evangelos Ververas, Viktoriia Sharmanska, Stefanos Zafeiriou

We present Free-HeadGAN, a person-generic neural talking head synthesis system. We show that modeling faces with sparse 3D facial landmarks are sufficient for achieving state-of-the-art generative performance, without re…

Few-Shot LearningGaze Estimation

FreeGaze: Resource-efficient Gaze Estimation via Frequency Domain Contrastive Learning

2022-09-14 · Lingyu Du, Guohao Lan

Gaze estimation is of great importance to many scientific fields and daily applications, ranging from fundamental research in cognitive psychology to attention-aware mobile systems. While recent advancements in deep lear…

Contrastive LearningGaze EstimationRepresentation Learning