Learning Efficient Representations of Mouse Movements to Predict User Attention
Tracking mouse cursor movements can be used to predict user attention on heterogeneous page layouts like SERPs. So far, previous work has relied heavily on handcrafted features, which is a time-consuming approach that often requires domain expertise. We investigate different representations of mouse cursor movements, including time series, heatmaps, and trajectory-based images, to build and contrast both recurrent and convolutional neural networks that can predict user attention to direct displays, such as SERP advertisements. Our models are trained over raw mouse cursor data and achieve competitive performance. We conclude that neural network models should be adopted for downstream tasks involving mouse cursor movements, since they can provide an invaluable implicit feedback signal for re-ranking and evaluation.
Code (1)
Tasks
Re-RankingTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Query Abandonment Prediction with Recurrent Neural Models of Mouse Cursor Movements
Most successful search queries do not result in a click if the user can satisfy their information needs directly on the SERP. Modeling query abandonment in the absence of click-through data is challenging because search …
Continuous Authentication Using Mouse Movements, Machine Learning, and Minecraft
Mouse dynamics has grown in popularity as a novel irreproducible behavioral biometric. Datasets which contain general unrestricted mouse movements from users are sparse in the current literature. The Balabit mouse dynami…
BIG-bench Machine LearningMinecraftLinear Predictive Coding for Acute Stress Prediction from Computer Mouse Movements
Prior work demonstrated the potential of using the Linear Predictive Coding (LPC) filter to approximate muscle stiffness and damping from computer mouse movements to predict acute stress levels of users. Theoretically, m…
Binary ClassificationMy Mouse, My Rules: Privacy Issues of Behavioral User Profiling via Mouse Tracking
This paper aims to stir debate about a disconcerting privacy issue on web browsing that could easily emerge because of unethical practices and uncontrolled use of technology. We demonstrate how straightforward is to capt…
Predicting respondent difficulty in web surveys: A machine-learning approach based on mouse movement features
A central goal of survey research is to collect robust and reliable data from respondents. However, despite researchers' best efforts in designing questionnaires, respondents may experience difficulty understanding quest…
BIG-bench Machine LearningSurvey