paper-with-me

홈 › Papers

Gaze-Vergence-Controlled See-Through Vision in Augmented Reality

2022-07-06 · Zhimin Wang, Yuxin Zhao, Feng Lu

Augmented Reality (AR) see-through vision is an interesting research topic since it enables users to see through a wall and see the occluded objects. Most existing research focuses on the visual effects of see-through vision, while the interaction method is less studied. However, we argue that using common interaction modalities, e.g., midair click and speech, may not be the optimal way to control see-through vision. This is because when we want to see through something, it is physically related to our gaze depth/vergence and thus should be naturally controlled by the eyes. Following this idea, this paper proposes a novel gaze-vergence-controlled (GVC) see-through vision technique in AR. Since gaze depth is needed, we build a gaze tracking module with two infrared cameras and the corresponding algorithm and assemble it into the Microsoft HoloLens 2 to achieve gaze depth estimation. We then propose two different GVC modes for see-through vision to fit different scenarios. Extensive experimental results demonstrate that our gaze depth estimation is efficient and accurate. By comparing with conventional interaction modalities, our GVC techniques are also shown to be superior in terms of efficiency and more preferred by users. Finally, we present four example applications of gaze-vergence-controlled see-through vision.

📄 PDF Abstract BibTeX arXiv:2207.02645

Code (0)

등록된 구현이 없습니다.

Tasks

Depth Estimation

Similar Papers 제목 키워드 기반

Eye Gaze Controlled Robotic Arm for Persons with SSMI

2020-05-25 · Vinay Krishna Sharma, L. R. D. Murthy, KamalPreet Singh Saluja, Vimal Mollyn 외

Background: People with severe speech and motor impairment (SSMI) often uses a technique called eye pointing to communicate with outside world. One of their parents, caretakers or teachers hold a printed board in front o…

How Much Future Helps? A Controlled Study of Future-Privileged Supervision for Causal Egocentric Gaze Estimation

2026-07-01 · Jia Li, Wenjie Zhao, Fnu Atisri, Sanskriti Aripineni 외 arxiv

Egocentric gaze estimation is commonly studied using models that process the full video with access to future frames, while real-world applications require strictly causal, online prediction. This discrepancy raises key …

Gaze Estimation

3D Gaussian and Diffusion-Based Gaze Redirection

2025-11-14 · Abiram Panchalingam, Indu Bodala, Stuart Middleton arxiv

High-fidelity gaze redirection is critical for generating augmented data to improve the generalization of gaze estimators. 3D Gaussian Splatting (3DGS) models like GazeGaussian represent the state-of-the-art but can stru…

Automatic Gaze Analysis: A Survey of Deep Learning based Approaches

2021-08-12 · Shreya Ghosh, Abhinav Dhall, Munawar Hayat, Jarrod Knibbe 외

Eye gaze analysis is an important research problem in the field of Computer Vision and Human-Computer Interaction. Even with notable progress in the last 10 years, automatic gaze analysis still remains challenging due to…

Deep LearningGaze EstimationSurvey

Improving Domain Generalization on Gaze Estimation via Branch-out Auxiliary Regularization

2024-05-02 · Ruijie Zhao, Pinyan Tang, Sihui Luo

Despite remarkable advancements, mainstream gaze estimation techniques, particularly appearance-based methods, often suffer from performance degradation in uncontrolled environments due to variations in illumination and …

Domain AdaptationDomain GeneralizationGaze Estimation