paper-with-me

홈 › Papers

Decoding Reading Goals from Eye Movements

2024-10-28 · Omer Shubi, Cfir Avraham Hadar, Yevgeni Berzak

Readers can have different goals with respect to the text they are reading. Can these goals be decoded from the pattern of their eye movements over the text? In this work, we examine for the first time whether it is possible to decode two types of reading goals that are common in daily life: information seeking and ordinary reading. Using large scale eye-tracking data, we apply to this task a wide range of state-of-the-art models for eye movements and text that cover different architectural and data representation strategies, and further introduce a new model ensemble. We systematically evaluate these models at three levels of generalization: new textual item, new participant, and the combination of both. We find that eye movements contain highly valuable signals for this task. We further perform an error analysis which builds on prior empirical findings on differences between ordinary reading and information seeking and leverages rich textual annotations. This analysis reveals key properties of textual items and participant eye movements that contribute to the difficulty of the task.

📄 PDF Abstract BibTeX arXiv:2410.20779

Code (1)

lacclab/Goal-Decoding-from-Eye-Movements 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Decoding Open-Ended Information Seeking Goals from Eye Movements in Reading

2025-05-04 · Cfir Avraham Hadar, Omer Shubi, Yoav Meiri, Yevgeni Berzak

When reading, we often have specific information that interests us in a text. For example, you might be reading this paper because you are curious about LLMs for eye movements in reading, the experimental design, or perh…

Experimental Design

Lip reading using external viseme decoding

2021-04-10 · Javad Peymanfard, Mohammad Reza Mohammadi, Hossein Zeinali, Nasser Mozayani

Lip-reading is the operation of recognizing speech from lip movements. This is a difficult task because the movements of the lips when pronouncing the words are similar for some of them. Viseme is used to describe lip mo…

Lip Reading

EMTeC: A Corpus of Eye Movements on Machine-Generated Texts

2024-08-08 · Lena Sophia Bolliger, Patrick Haller, Isabelle Caroline Rose Cretton, David Robert Reich 외

The Eye Movements on Machine-Generated Texts Corpus (EMTeC) is a naturalistic eye-movements-while-reading corpus of 107 native English speakers reading machine-generated texts. The texts are generated by three large lang…

Déjà Vu? Decoding Repeated Reading from Eye Movements

2025-02-16 · Yoav Meiri, Omer Shubi, Cfir Avraham Hadar, Ariel Kreisberg Nitzav 외

Be it your favorite novel, a newswire article, a cooking recipe or an academic paper -- in many daily situations we read the same text more than once. In this work, we ask whether it is possible to automatically determin…

Fine-Grained Prediction of Reading Comprehension from Eye Movements

2024-10-06 · Omer Shubi, Yoav Meiri, Cfir Avraham Hadar, Yevgeni Berzak

Can human reading comprehension be assessed from eye movements in reading? In this work, we address this longstanding question using large-scale eyetracking data over textual materials that are geared towards behavioral …

PredictionReading Comprehension