paper-with-me

Papers

CapStARE: Capsule-based Sequential Architecture for Robust and Efficient Gaze Estimation

2025-09-24 · Miren Samaniego, Igor Rodriguez, Elena Lazkano arxiv

Human gaze estimation is essential for applications such as human-computer interaction, social robotics, and assistive systems. However, achieving accurate, interpretable, and real-time performance in unconstrained environments remains challenging. Existing appearance-based methods often face trade-offs between spatial robustness, computational efficiency, and effective use of contextual information. To address this, we introduce CapStARE, a capsule-based architecture that combines a frozen ConvNeXt backbone for efficient feature extraction, capsule formation with attention-based routing for structured facial reasoning, and dual GRU decoders for lightweight sequential modeling over short-horizon observation windows. This design preserves interpretable part-whole facial relationships while improving prediction stability through local contextual consistency. Experimental results demonstrate strong performance on ETH-XGaze (3.36) and MPIIFaceGaze (2.65), while also generalizing competitively on Gaze360 (9.06), all with real-time inference (<10 ms). These findings suggest that the proposed method provides a practical and robust framework for appearance-based gaze estimation in real-world interactive environments. The related code and experimental results are publicly available at: https://github.com/toukapy/capsStare

📄 PDF Abstract BibTeX arXiv:2509.19936

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyGaze Estimation

Similar Papers 제목 키워드 기반

Gaze-Net: Appearance-Based Gaze Estimation using Capsule Networks

2020-04-16 · Bhanuka Mahanama, Yasith Jayawardana, Sampath Jayarathna

Recent studies on appearance based gaze estimation indicate the ability of Neural Networks to decode gaze information from facial images encompassing pose information. In this paper, we propose Gaze-Net: A capsule networ…

Gaze EstimationTransfer Learning

RAZE: Region Guided Self-Supervised Gaze Representation Learning

2022-08-04 · Neeru Dubey, Shreya Ghosh, Abhinav Dhall

Automatic eye gaze estimation is an important problem in vision based assistive technology with use cases in different emerging topics such as augmented reality, virtual reality and human-computer interaction. Over the p…

Gaze EstimationRepresentation LearningSelf-Supervised Learning

Gaze Estimation with an Ensemble of Four Architectures

2021-07-05 · Xin Cai, BoYu Chen, Jiabei Zeng, Jiajun Zhang 외

This paper presents a method for gaze estimation according to face images. We train several gaze estimators adopting four different network architectures, including an architecture designed for gaze estimation (i.e.,iTra…

Gaze Estimation

TCDCaps: Visual Tracking via Cascaded Dense Capsules

2019-02-26 · Ding Ma, Xiangqian Wu

The critical challenge in tracking-by-detection framework is how to avoid drift problem during online learning, where the robust features for a variety of appearance changes are difficult to be learned and a reasonable i…

Visual Tracking

Investigation of Architectures and Receptive Fields for Appearance-based Gaze Estimation

2023-08-18 · Yunhan Wang, Xiangwei Shi, Shalini De Mello, Hyung Jin Chang 외

With the rapid development of deep learning technology in the past decade, appearance-based gaze estimation has attracted great attention from both computer vision and human-computer interaction research communities. Fas…

Contrastive LearningDisentanglementGaze EstimationHard Attention