Rendering of Eyes for Eye-Shape Registration and Gaze Estimation
Images of the eye are key in several computer vision problems, such as shape registration and gaze estimation. Recent large-scale supervised methods for these problems require time-consuming data collection and manual annotation, which can be unreliable. We propose synthesizing perfectly labelled photo-realistic training data in a fraction of the time. We used computer graphics techniques to build a collection of dynamic eye-region models from head scan geometry. These were randomly posed to synthesize close-up eye images for a wide range of head poses, gaze directions, and illumination conditions. We used our model's controllability to verify the importance of realistic illumination and shape variations in eye-region training data. Finally, we demonstrate the benefits of our synthesized training data (SynthesEyes) by out-performing state-of-the-art methods for eye-shape registration as well as cross-dataset appearance-based gaze estimation in the wild.
Code (0)
등록된 구현이 없습니다.
Tasks
Gaze EstimationSimilar Papers 제목 키워드 기반
RT-BENE: A Dataset and Baselines for Real-Time Blink Estimation in Natural Environments
In recent years gaze estimation methods have made substantial progress, driven by the numerous application areas including human-robot interaction, visual attention estimation and foveated rendering for virtual reality h…
Blink estimationGaze EstimationGazeDirector: Fully Articulated Eye Gaze Redirection in Video
We present GazeDirector, a new approach for eye gaze redirection that uses model-fitting. Our method first tracks the eyes by fitting a multi-part eye region model to video frames using analysis-by-synthesis, thereby rec…
Gaze Estimationgaze redirectionMagicEyes: A Large Scale Eye Gaze Estimation Dataset for Mixed Reality
With the emergence of Virtual and Mixed Reality (XR) devices, eye tracking has received significant attention in the computer vision community. Eye gaze estimation is a crucial component in XR -- enabling energy efficien…
BlockingGaze EstimationMixed RealityEyeNet: A Multi-Task Network for Off-Axis Eye Gaze Estimation and User Understanding
Eye gaze estimation and simultaneous semantic understanding of a user through eye images is a crucial component in Virtual and Mixed Reality; enabling energy efficient rendering, multi-focal displays and effective intera…
BlockingGaze EstimationMixed RealityNeRF-Gaze: A Head-Eye Redirection Parametric Model for Gaze Estimation
Gaze estimation is the fundamental basis for many visual tasks. Yet, the high cost of acquiring gaze datasets with 3D annotations hinders the optimization and application of gaze estimation models. In this work, we propo…
Domain AdaptationDomain GeneralizationGaze EstimationNeRF+1