paper-with-me

홈 › Papers

RIT-Eyes: Rendering of near-eye images for eye-tracking applications

2020-06-05 · Nitinraj Nair, Rakshit Kothari, Aayush K. Chaudhary, Zhizhuo Yang, Gabriel J. Diaz, Jeff B. Pelz, Reynold J. Bailey

Deep neural networks for video-based eye tracking have demonstrated resilience to noisy environments, stray reflections, and low resolution. However, to train these networks, a large number of manually annotated images are required. To alleviate the cumbersome process of manual labeling, computer graphics rendering is employed to automatically generate a large corpus of annotated eye images under various conditions. In this work, we introduce a synthetic eye image generation platform that improves upon previous work by adding features such as an active deformable iris, an aspherical cornea, retinal retro-reflection, gaze-coordinated eye-lid deformations, and blinks. To demonstrate the utility of our platform, we render images reflecting the represented gaze distributions inherent in two publicly available datasets, NVGaze and OpenEDS. We also report on the performance of two semantic segmentation architectures (SegNet and RITnet) trained on rendered images and tested on the original datasets.

📄 PDF Abstract BibTeX arXiv:2006.03642

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationSemantic Segmentation

Similar Papers 제목 키워드 기반

MagicEyes: A Large Scale Eye Gaze Estimation Dataset for Mixed Reality

2020-03-18 · Zhengyang Wu, Srivignesh Rajendran, Tarrence van As, Joelle Zimmermann 외

With the emergence of Virtual and Mixed Reality (XR) devices, eye tracking has received significant attention in the computer vision community. Eye gaze estimation is a crucial component in XR -- enabling energy efficien…

BlockingGaze EstimationMixed Reality

Skyeyes: Ground Roaming using Aerial View Images

2024-09-25 · Zhiyuan Gao, Wenbin Teng, Gonglin Chen, Jinsen Wu 외

Integrating aerial imagery-based scene generation into applications like autonomous driving and gaming enhances realism in 3D environments, but challenges remain in creating detailed content for occluded areas and ensuri…

Autonomous DrivingScene Generation

LEyes: A Lightweight Framework for Deep Learning-Based Eye Tracking using Synthetic Eye Images

2023-09-12 · Sean Anthony Byrne, Virmarie Maquiling, Marcus Nyström, Enkelejda Kasneci 외

Deep learning has bolstered gaze estimation techniques, but real-world deployment has been impeded by inadequate training datasets. This problem is exacerbated by both hardware-induced variations in eye images and inhere…

Gaze EstimationSynthetic Data Generation

Gaze Gestures and Their Applications in human-computer interaction with a head-mounted display

2019-10-16 · W. X. Chen, X. Y. Cui, J. Zheng, J. M. Zhang 외

A head-mounted display (HMD) is a portable and interactive display device. With the development of 5G technology, it may become a general-purpose computing platform in the future. Human-computer interaction (HCI) technol…

3D Camouflaging Object using RGB-D Sensors

2017-09-24 · Ahmed M. Siddek, Mohsen A. Rashwan, Islam A. Eshrah

This paper proposes a new optical camouflage system that uses RGB-D cameras, for acquiring point cloud of background scene, and tracking observers eyes. This system enables a user to conceal an object located behind a di…

Object