EllSeg: An Ellipse Segmentation Framework for Robust Gaze Tracking
Ellipse fitting, an essential component in pupil or iris tracking based video oculography, is performed on previously segmented eye parts generated using various computer vision techniques. Several factors, such as occlusions due to eyelid shape, camera position or eyelashes, frequently break ellipse fitting algorithms that rely on well-defined pupil or iris edge segments. In this work, we propose training a convolutional neural network to directly segment entire elliptical structures and demonstrate that such a framework is robust to occlusions and offers superior pupil and iris tracking performance (at least 10$\%$ and 24$\%$ increase in pupil and iris center detection rate respectively within a two-pixel error margin) compared to using standard eye parts segmentation for multiple publicly available synthetic segmentation datasets.
Code (3)
Tasks
PositionSegmentationSimilar Papers 제목 키워드 기반
CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentation
Parsing of eye components (i.e. pupil, iris and sclera) is fundamental for eye tracking and gaze estimation for AR/VR products. Mainstream approaches tackle this problem as a multi-class segmentation task, providing only…
Gaze EstimationSegmentationGazeTrack: High-Precision Eye Tracking Based on Regularization and Spatial Computing
Eye tracking has become increasingly important in virtual and augmented reality applications; however, the current gaze accuracy falls short of meeting the requirements for spatial computing. We designed a gaze collectio…
Semantic SegmentationCenter of circle after perspective transformation
Video-based glint-free eye tracking commonly estimates gaze direction based on the pupil center. The boundary of the pupil is fitted with an ellipse and the euclidean center of the ellipse in the image is taken as the ce…
EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking
The study of human gaze behavior in natural contexts requires algorithms for gaze estimation that are robust to a wide range of imaging conditions. However, algorithms often fail to identify features such as the iris and…
Domain GeneralizationGaze EstimationFACET: Fast and Accurate Event-Based Eye Tracking Using Ellipse Modeling for Extended Reality
Eye tracking is a key technology for gaze-based interactions in Extended Reality (XR), but traditional frame-based systems struggle to meet XR's demands for high accuracy, low latency, and power efficiency. Event cameras…