Agent-Guided Gaze Estimation Network by Two-Eye Asymmetry Exploration
Gaze estimation is an important task in understanding human visual attention. Despite the performance gain brought by recent algorithm development, the task remains challenging due to two-eye appearance asymmetry resulting from head pose variation and nonuniform illumination. In this paper, we propose a novel architecture, Agent-guided Gaze Estimation Network (AGE-Net), to make full and efficient use of two-eye features. By exploring the appearance asymmetry and the consequent feature space asymmetry, we devise a main branch and two agent regression tasks. The main branch extracts related features of the left and right eyes from low-level semantics. Meanwhile, the agent regression tasks extract asymmetric features of the left and right eyes from high-level semantics, so as to guide the main branch to learn more about the eye feature space. Experiments show that our method achieves state-of-the-art gaze estimation task performance on both MPIIGaze and EyeDiap datasets.
Code (1)
Tasks
Gaze EstimationregressionSimilar Papers 제목 키워드 기반
Appearance-Based Gaze Estimation via Evaluation-Guided Asymmetric Regression
Eye gaze estimation has been increasingly demanded by recent intelligent systems to accomplish a range of interaction-related tasks, by using simple eye images as input. However, learning the highly complex regression be…
Gaze EstimationregressionInvestigation of Architectures and Receptive Fields for Appearance-based Gaze Estimation
With the rapid development of deep learning technology in the past decade, appearance-based gaze estimation has attracted great attention from both computer vision and human-computer interaction research communities. Fas…
Contrastive LearningDisentanglementGaze EstimationHard AttentionGaze on the Prize: Shaping Visual Attention with Return-Guided Contrastive Learning
Visual Reinforcement Learning (RL) agents must learn to act based on high-dimensional image data where only a small fraction of the pixels is task-relevant. This forces agents to waste exploration and computational resou…
Reinforcement LearningContrastive LearningLG-Gaze: Learning Geometry-aware Continuous Prompts for Language-Guided Gaze Estimation
The ability of gaze estimation models to generalize is often significantly hindered by various factors unrelated to gaze, especially when the training dataset is limited. Current strategies aim to address this challenge …
Domain GeneralizationGaze EstimationregressionRAZE: Region Guided Self-Supervised Gaze Representation Learning
Automatic eye gaze estimation is an important problem in vision based assistive technology with use cases in different emerging topics such as augmented reality, virtual reality and human-computer interaction. Over the p…
Gaze EstimationRepresentation LearningSelf-Supervised Learning