A Probabilistic Time-Evolving Approach to Scanpath Prediction
Human visual attention is a complex phenomenon that has been studied for decades. Within it, the particular problem of scanpath prediction poses a challenge, particularly due to the inter- and intra-observer variability, among other reasons. Besides, most existing approaches to scanpath prediction have focused on optimizing the prediction of a gaze point given the previous ones. In this work, we present a probabilistic time-evolving approach to scanpath prediction, based on Bayesian deep learning. We optimize our model using a novel spatio-temporal loss function based on a combination of Kullback-Leibler divergence and dynamic time warping, jointly considering the spatial and temporal dimensions of scanpaths. Our scanpath prediction framework yields results that outperform those of current state-of-the-art approaches, and are almost on par with the human baseline, suggesting that our model is able to generate scanpaths whose behavior closely resembles those of the real ones.
Code (0)
등록된 구현이 없습니다.
Tasks
Dynamic Time WarpingPredictionScanpath predictionSimilar Papers 제목 키워드 기반
Human Scanpath Prediction in Target-Present Visual Search with Semantic-Foveal Bayesian Attention
In goal-directed visual tasks, human perception is guided by both top-down and bottom-up cues. At the same time, foveal vision plays a crucial role in directing attention efficiently. Modern research on bio-inspired comp…
Scanpath predictionObject DetectionScanpath Prediction on Information Visualisations
We propose Unified Model of Saliency and Scanpaths (UMSS) -- a model that learns to predict visual saliency and scanpaths (i.e. sequences of eye fixations) on information visualisations. Although scanpaths provide rich i…
PredictionSaliency PredictionScanpath predictionFew-shot Personalized Scanpath Prediction
A personalized model for scanpath prediction provides insights into the visual preferences and attention patterns of individual subjects. However, existing methods for training scanpath prediction models are data-int…
PredictionScanpath predictionPredicting Human Scanpaths in Visual Question Answering
Attention has been an important mechanism for both humans and computer vision systems. While state-of-the-art models to predict attention focus on estimating a static probabilistic saliency map with free-viewing beha…
Deep Reinforcement LearningQuestion AnsweringScanpath predictionTemporal Sequences+2State-of-the-Art in Human Scanpath Prediction
The last years have seen a surge in models predicting the scanpaths of fixations made by humans when viewing images. However, the field is lacking a principled comparison of those models with respect to their predictive …
BenchmarkingPredictionScanpath prediction