Causal Representation-Based Domain Generalization on Gaze Estimation
The availability of extensive datasets containing gaze information for each subject has significantly enhanced gaze estimation accuracy. However, the discrepancy between domains severely affects a model's performance explicitly trained for a particular domain. In this paper, we propose the Causal Representation-Based Domain Generalization on Gaze Estimation (CauGE) framework designed based on the general principle of causal mechanisms, which is consistent with the domain difference. We employ an adversarial training manner and an additional penalizing term to extract domain-invariant features. After extracting features, we position the attention layer to make features sufficient for inferring the actual gaze. By leveraging these modules, CauGE ensures that the neural networks learn from representations that meet the causal mechanisms' general principles. By this, CauGE generalizes across domains by extracting domain-invariant features, and spurious correlations cannot influence the model. Our method achieves state-of-the-art performance in the domain generalization on gaze estimation benchmark.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain GeneralizationGaze EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Contrastive Regression for Domain Adaptation on Gaze Estimation
Appearance-based Gaze Estimation leverages deep neural networks to regress the gaze direction from monocular images and achieve impressive performance. However, its success depends on expensive and cumbersome annotat…
Domain AdaptationDomain GeneralizationGaze EstimationregressionPureGaze: Purifying Gaze Feature for Generalizable Gaze Estimation
Gaze estimation methods learn eye gaze from facial features. However, among rich information in the facial image, real gaze-relevant features only correspond to subtle changes in eye region, while other gaze-irrelevant f…
Domain AdaptationDomain GeneralizationGaze EstimationUniGaze: Towards Universal Gaze Estimation via Large-scale Pre-Training
Despite decades of research on data collection and model architectures, current gaze estimation models face significant challenges in generalizing across diverse data domains. While recent advances in self-supervised pre…
Gaze EstimationContrastive Weighted Learning for Near-Infrared Gaze Estimation
Appearance-based gaze estimation has been very successful with the use of deep learning. Many following works improved domain generalization for gaze estimation. However, even though there has been much progress in domai…
Adversarial AttackContrastive LearningData AugmentationDomain Generalization+2From Feature to Gaze: A Generalizable Replacement of Linear Layer for Gaze Estimation
Deep-learning-based gaze estimation approaches often suffer from notable performance degradation in unseen target domains. One of the primary reasons is that the Fully Connected layer is highly prone to overfitting w…
Gaze Estimation