Polarization-Based Eye Tracking with Personalized Siamese Architectures
Head-mounted devices integrated with eye tracking promise a solution for natural human-computer interaction. However, they typically require per-user calibration for optimal performance due to inter-person variability. A differential personalization approach using Siamese architectures learns relative gaze displacements and reconstructs absolute gaze from a small set of calibration frames. In this paper, we benchmark Siamese personalization on polarization-enabled eye tracking. For benchmarking, we use a 338-subject dataset captured with a polarization-sensitive camera and 850 nm illumination. We achieve performance comparable to linear calibration with 10-fold fewer samples. Using polarization inputs for Siamese personalization reduces gaze error by up to 12% compared to near-infrared (NIR)-based inputs. Combining Siamese personalization with linear calibration yields further improvements of up to 13% over a linearly calibrated baseline. These results establish Siamese personalization as a practical approach enabling accurate eye tracking.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Deeper and Wider Siamese Networks for Real-Time Visual Tracking
Siamese networks have drawn great attention in visual tracking because of their balanced accuracy and speed. However, the backbone networks used in Siamese trackers are relatively shallow, such as AlexNet [18], which doe…
Real-Time Visual TrackingVideo Object TrackingVisual Object TrackingVisual TrackingA Survey for Deep RGBT Tracking
Visual object tracking with the visible (RGB) and thermal infrared (TIR) electromagnetic waves, shorted in RGBT tracking, recently draws increasing attention in the tracking community. Considering the rapid development o…
Object TrackingSurveyVisual Object TrackingScale Equivariance Improves Siamese Tracking
Siamese trackers turn tracking into similarity estimation between a template and the candidate regions in the frame. Mathematically, one of the key ingredients of success of the similarity function is translation equivar…
Object TrackingTranslationVisual Object TrackingVisual TrackingRotation Equivariant Siamese Networks for Tracking
Rotation is among the long prevailing, yet still unresolved, hard challenges encountered in visual object tracking. The existing deep learning-based tracking algorithms use regular CNNs that are inherently translation eq…
2D Pose EstimationBenchmarkingObject TrackingPose Estimation+1Siamese Natural Language Tracker: Tracking by Natural Language Descriptions with Siamese Trackers
We propose a novel Siamese Natural Language Tracker (SNLT), which brings the advancements in visual tracking to the tracking by natural language (NL) descriptions task. The proposed SNLT is applicable to a wide range of …
GPUObject TrackingRegion ProposalVisual Object Tracking+1