Unsupervised Learning of Eye Gaze Representation from the Web
Automatic eye gaze estimation has interested researchers for a while now. In this paper, we propose an unsupervised learning based method for estimating the eye gaze region. To train the proposed network "Ize-Net" in self-supervised manner, we collect a large `in the wild' dataset containing 1,54,251 images from the web. For the images in the database, we divide the gaze into three regions based on an automatic technique based on pupil-centers localization and then use a feature-based technique to determine the gaze region. The performance is evaluated on the Tablet Gaze and CAVE datasets by fine-tuning results of Ize-Net for the task of eye gaze estimation. The feature representation learned is also used to train traditional machine learning algorithms for eye gaze estimation. The results demonstrate that the proposed method learns a rich data representation, which can be efficiently fine-tuned for any eye gaze estimation dataset.
Code (1)
Tasks
Gaze EstimationSimilar Papers 제목 키워드 기반
Unsupervised Gaze Representation Learning from Multi-view Face Images
Annotating gaze is an expensive and time-consuming endeavor requiring costly eye-trackers or complex geometric calibration procedures. Although some eye-based unsupervised gaze representation learning methods have be…
Gaze EstimationRepresentation LearningUnsupervised Gaze-aware Contrastive Learning with Subject-specific Condition
Appearance-based gaze estimation has shown great promise in many applications by using a single general-purpose camera as the input device. However, its success is highly depending on the availability of large-scale well…
Contrastive LearningData AugmentationGaze EstimationRepresentation LearningCross-Encoder for Unsupervised Gaze Representation Learning
In order to train 3D gaze estimators without too many annotations, we propose an unsupervised learning framework, Cross-Encoder, to leverage the unlabeled data to learn suitable representation for gaze estimation. To…
Gaze EstimationRepresentation LearningLearning Unsupervised Gaze Representation via Eye Mask Driven Information Bottleneck
Appearance-based supervised methods with full-face image input have made tremendous advances in recent gaze estimation tasks. However, intensive human annotation requirement inhibits current methods from achieving indust…
Gaze EstimationUnsupervised Pre-trainingUnsupervised Representation Learning for Gaze Estimation
Although automatic gaze estimation is very important to a large variety of application areas, it is difficult to train accurate and robust gaze models, in great part due to the difficulty in collecting large and diverse …
Gaze Estimationgaze redirectionHead Pose EstimationPose Estimation+1