EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking
The study of human gaze behavior in natural contexts requires algorithms for gaze estimation that are robust to a wide range of imaging conditions. However, algorithms often fail to identify features such as the iris and pupil centroid in the presence of reflective artifacts and occlusions. Previous work has shown that convolutional networks excel at extracting gaze features despite the presence of such artifacts. However, these networks often perform poorly on data unseen during training. This work follows the intuition that jointly training a convolutional network with multiple datasets learns a generalized representation of eye parts. We compare the performance of a single model trained with multiple datasets against a pool of models trained on individual datasets. Results indicate that models tested on datasets in which eye images exhibit higher appearance variability benefit from multiset training. In contrast, dataset-specific models generalize better onto eye images with lower appearance variability.
Code (1)
Tasks
Domain GeneralizationGaze EstimationSimilar Papers 제목 키워드 기반
ATSal: An Attention Based Architecture for Saliency Prediction in 360 Videos
The spherical domain representation of 360 video/image presents many challenges related to the storage, processing, transmission and rendering of omnidirectional videos (ODV). Models of human visual attention can be used…
Saliency PredictionCellSeg1: Robust Cell Segmentation with One Training Image
Recent trends in cell segmentation have shifted towards universal models to handle diverse cell morphologies and imaging modalities. However, for continuously emerging cell types and imaging techniques, these models stil…
Cell SegmentationSegmentationAdversarial Domain Adaptation for Cell Segmentation
To successfully train a cell segmentation network in fully-supervised manner for a particular type of organ or cancer, we need the dataset with ground-truth annotations. However, high unavailability of such annotated dat…
Cell SegmentationDomain AdaptationSegmentationSemi-supervised Domain Adaptation+1Reading-Time Annotations for ``Balanced Corpus of Contemporary Written Japanese''
The Dundee Eyetracking Corpus contains eyetracking data collected while native speakers of English and French read newspaper editorial articles. Similar resources for other languages are still rare, especially for langua…
ArticlesEnhancing Facial Expression Recognition in Head-Mounted Displays with Synthetic Data
Facial expression recognition (FER) is crucial for social interaction in mixed reality environments that employ head-mounted displays (HMD). However, collecting FER data from head-mounted cameras (HMC) is challenging due…
Facial Expression Recognition