paper-with-me

홈 › Papers

Saccade Sequence Prediction: Beyond Static Saliency Maps

2017-11-29 · Calden Wloka, Iuliia Kotseruba, John K. Tsotsos

Visual attention is a field with a considerable history, with eye movement control and prediction forming an important subfield. Fixation modeling in the past decades has been largely dominated computationally by a number of highly influential bottom-up saliency models, such as the Itti-Koch-Niebur model. The accuracy of such models has dramatically increased recently due to deep learning. However, on static images the emphasis of these models has largely been based on non-ordered prediction of fixations through a saliency map. Very few implemented models can generate temporally ordered human-like sequences of saccades beyond an initial fixation point. Towards addressing these shortcomings we present STAR-FC, a novel multi-saccade generator based on a central/peripheral integration of deep learning-based saliency and lower-level feature-based saliency. We have evaluated our model using the CAT2000 database, successfully predicting human patterns of fixation with equivalent accuracy and quality compared to what can be achieved by using one human sequence to predict another. This is a significant improvement over fixation sequences predicted by state-of-the-art saliency algorithms.

📄 PDF Abstract BibTeX arXiv:1711.10959

Code (0)

등록된 구현이 없습니다.

Tasks

Prediction

Similar Papers 제목 키워드 기반

Active Fixation Control to Predict Saccade Sequences

2018-06-01 · CVPR 2018 6 · Calden Wloka, Iuliia Kotseruba, John K. Tsotsos

Visual attention is a field with a considerable history, with eye movement control and prediction forming an important subfield. Fixation modeling in the past decades has been largely dominated computationally by a numbe…

Modeling Bottom-Up and Top-Down Attention with a Neurodynamic Model of V1

2019-11-18

Previous studies suggested that lateral interactions of V1 cells are responsible, among other visual effects, of bottom-up visual attention (alternatively named visual salience or saliency). Our objective is to mimic the…

Saliency Prediction

Bridging the Gap: Gaze Events as Interpretable Concepts to Explain Deep Neural Sequence Models

2023-04-12 · Daniel G. Krakowczyk, Paul Prasse, David R. Reich, Sebastian Lapuschkin 외

Recent work in XAI for eye tracking data has evaluated the suitability of feature attribution methods to explain the output of deep neural sequence models for the task of oculomotric biometric identification. These metho…

Event DetectionExplainable Artificial Intelligence (XAI)

Searchers adjust their eye movement dynamics to the target characteristics in natural scenes

2018-02-12

When searching a target in a natural scene, both the target's visual properties and similarity to the background influence whether (and how fast) humans are able to find it. However, thus far it has been unclear whether …

Specificity

Viewport Prediction for Volumetric Video Streaming by Exploring Video Saliency and Trajectory Information

2023-11-28 · Jie Li, Zhixin Li, Zhi Liu, Pengyuan Zhou 외

Volumetric video, also known as hologram video, is a novel medium that portrays natural content in Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). It is expected to be the next-gen video technology …

Mixed RealityPredictionSaliency Detection