Domain Adaptation Gaze Estimation by Embedding with Prediction Consistency
Gaze is the essential manifestation of human attention. In recent years, a series of work has achieved high accuracy in gaze estimation. However, the inter-personal difference limits the reduction of the subject-independent gaze estimation error. This paper proposes an unsupervised method for domain adaptation gaze estimation to eliminate the impact of inter-personal diversity. In domain adaption, we design an embedding representation with prediction consistency to ensure that the linear relationship between gaze directions in different domains remains consistent on gaze space and embedding space. Specifically, we employ source gaze to form a locally linear representation in the gaze space for each target domain prediction. Then the same linear combinations are applied in the embedding space to generate hypothesis embedding for the target domain sample, remaining prediction consistency. The deviation between the target and source domain is reduced by approximating the predicted and hypothesis embedding for the target domain sample. Guided by the proposed strategy, we design Domain Adaptation Gaze Estimation Network(DAGEN), which learns embedding with prediction consistency and achieves state-of-the-art results on both the MPIIGaze and the EYEDIAP datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityDomain AdaptationGaze EstimationPredictionSimilar Papers 제목 키워드 기반
Source-Free Adaptive Gaze Estimation by Uncertainty Reduction
Gaze estimation across domains has been explored recently because the training data are usually collected under controlled conditions while the trained gaze estimators are used in real and diverse environments. Howev…
Domain AdaptationGaze EstimationSource-Free Domain AdaptationContrastive Regression for Domain Adaptation on Gaze Estimation
Appearance-based Gaze Estimation leverages deep neural networks to regress the gaze direction from monocular images and achieve impressive performance. However, its success depends on expensive and cumbersome annotat…
Domain AdaptationDomain GeneralizationGaze EstimationregressionJitter Does Matter: Adapting Gaze Estimation to New Domains
Deep neural networks have demonstrated superior performance on appearance-based gaze estimation tasks. However, due to variations in person, illuminations, and background, performance degrades dramatically when applying …
Adversarial AttackContrastive LearningDomain AdaptationGaze EstimationGeneralizing Gaze Estimation with Outlier-guided Collaborative Adaptation
Deep neural networks have significantly improved appearance-based gaze estimation accuracy. However, it still suffers from unsatisfactory performance when generalizing the trained model to new domains, e.g., unseen envir…
Domain AdaptationGaze Estimation3DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Views
Developing gaze estimation models that generalize well to unseen domains and in-the-wild conditions remains a challenge with no known best solution. This is mostly due to the difficulty of acquiring ground truth data tha…
3D geometryDomain AdaptationGaze EstimationHand Pose Estimation+1