Rendering refraction and reflection of eyeglasses for synthetic eye tracker images
While for the evaluation of robustness of eye tracking algorithms the use of real-world data is essential, there are many applications where simulated, synthetic eye images are of advantage. They can generate labelled ground-truth data for appearance based gaze estimation algorithms or enable the development of model based gaze estimation techniques by showing the influence on gaze estimation error of different model factors that can then be simplified or extended. We extend the generation of synthetic eye images by a simulation of refraction and reflection for eyeglasses. On the one hand this allows for the testing of pupil and glint detection algorithms under different illumination and reflection conditions, on the other hand the error of gaze estimation routines can be estimated in conjunction with different eyeglasses. We show how a polynomial function fitting calibration performs equally well with and without eyeglasses, and how a geometrical eye model behaves when exposed to glasses.
Code (0)
등록된 구현이 없습니다.
Tasks
Gaze EstimationSimilar Papers 제목 키워드 기반
REF$^2$-NeRF: Reflection and Refraction aware Neural Radiance Field
Recently, significant progress has been made in the study of methods for 3D reconstruction from multiple images using implicit neural representations, exemplified by the neural radiance field (NeRF) method. Such methods,…
3D ReconstructionNeRFThrough the Looking Glass: Neural 3D Reconstruction of Transparent Shapes
Recovering the 3D shape of transparent objects using a small number of unconstrained natural images is an ill-posed problem. Complex light paths induced by refraction and reflection have prevented both traditional and de…
3D geometry3D Point Cloud Reconstruction3D ReconstructionPoint cloud reconstruction+1Mesh deformation-based single-view 3D reconstruction of thin eyeglasses frames with differentiable rendering
With the support of Virtual Reality (VR) and Augmented Reality (AR) technologies, the 3D virtual eyeglasses try-on application is well on its way to becoming a new trending solution that offers a "try on" option to selec…
3D ReconstructionSingle-View 3D ReconstructionSeeing Through the Glass: Neural 3D Reconstruction of Object Inside a Transparent Container
In this paper, we define a new problem of recovering the 3D geometry of an object confined in a transparent enclosure. We also propose a novel method for solving this challenging problem. Transparent enclosures pose chal…
3D geometry3D ReconstructionDifferentiable Neural Surface Refinement for Modeling Transparent Objects
Neural implicit surface reconstruction leveraging volume rendering has led to significant advances in multi-view reconstruction. However results for transparent objects can be very poor primarily because the renderin…
Novel View SynthesisSurface ReconstructionTransparent objects