paper-with-me

홈 › Papers

L2CS-Net: Fine-Grained Gaze Estimation in Unconstrained Environments

2022-03-07 · Ahmed A. Abdelrahman, Thorsten Hempel, Aly Khalifa, Ayoub Al-Hamadi

Human gaze is a crucial cue used in various applications such as human-robot interaction and virtual reality. Recently, convolution neural network (CNN) approaches have made notable progress in predicting gaze direction. However, estimating gaze in-the-wild is still a challenging problem due to the uniqueness of eye appearance, lightning conditions, and the diversity of head pose and gaze directions. In this paper, we propose a robust CNN-based model for predicting gaze in unconstrained settings. We propose to regress each gaze angle separately to improve the per-angel prediction accuracy, which will enhance the overall gaze performance. In addition, we use two identical losses, one for each angle, to improve network learning and increase its generalization. We evaluate our model with two popular datasets collected with unconstrained settings. Our proposed model achieves state-of-the-art accuracy of 3.92{\deg} and 10.41{\deg} on MPIIGaze and Gaze360 datasets, respectively. We make our code open source at https://github.com/Ahmednull/L2CS-Net.

📄 PDF Abstract BibTeX arXiv:2203.03339

Code (2)

ahmednull/l2cs-net pytorch
yakhyo/gaze-estimation pytorch

Tasks

DiversityGaze EstimationGaze Prediction

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Weakly-Supervised Physically Unconstrained Gaze Estimation

2021-05-20 · CVPR 2021 1 · Rakshit Kothari, Shalini De Mello, Umar Iqbal, Wonmin Byeon 외

A major challenge for physically unconstrained gaze estimation is acquiring training data with 3D gaze annotations for in-the-wild and outdoor scenarios. In contrast, videos of human interactions in unconstrained environ…

Domain GeneralizationGaze Estimation

DHECA-SuperGaze: Dual Head-Eye Cross-Attention and Super-Resolution for Unconstrained Gaze Estimation

2025-05-13 · Franko Šikić, Donik Vršnak, Sven Lončarić

Unconstrained gaze estimation is the process of determining where a subject is directing their visual attention in uncontrolled environments. Gaze estimation systems are important for a myriad of tasks such as driver dis…

Gaze EstimationGaze PredictionSuper-Resolution

Gaze360: Physically Unconstrained Gaze Estimation in the Wild

2019-10-22 · ICCV 2019 10 · Petr Kellnhofer, Adria Recasens, Simon Stent, Wojciech Matusik 외

Understanding where people are looking is an informative social cue. In this work, we present Gaze360, a large-scale gaze-tracking dataset and method for robust 3D gaze estimation in unconstrained images. Our dataset con…

Domain AdaptationGaze Estimation

Enhancing 3D Gaze Estimation in the Wild using Weak Supervision with Gaze Following Labels

2025-02-27 · CVPR 2025 1 · Pierre Vuillecard, Jean-Marc Odobez

Accurate 3D gaze estimation in unconstrained real-world environments remains a significant challenge due to variations in appearance, head pose, occlusion, and the limited availability of in-the-wild 3D gaze datasets. To…

Domain GeneralizationGaze Estimation

Efficient CNN Implementation for Eye-Gaze Estimation on Low-Power/Low-Quality Consumer Imaging Systems

2018-06-28 · Joseph Lemley, Anuradha Kar, Alexandru Drimbarean, Peter Corcoran

Accurate and efficient eye gaze estimation is important for emerging consumer electronic systems such as driver monitoring systems and novel user interfaces. Such systems are required to operate reliably in difficult, un…

Gaze Estimation