paper-with-me

홈 › Papers

Detecting Reading-Induced Confusion Using EEG and Eye Tracking

2025-08-20 · Haojun Zhuang, Dünya Baradari, Nataliya Kosmyna, Arnav Balyan, Constanze Albrecht, Stephanie Chen, Pattie Maes arxiv

Humans regularly navigate an overwhelming amount of information via text media, whether reading articles, browsing social media, or interacting with chatbots. Confusion naturally arises when new information conflicts with or exceeds a reader's comprehension or prior knowledge, posing a challenge for learning. In this study, we present a multimodal investigation of reading-induced confusion using EEG and eye tracking. We collected neural and gaze data from 11 adult participants as they read short paragraphs sampled from diverse, real-world sources. By isolating the N400 event-related potential (ERP), a well-established neural marker of semantic incongruence, and integrating behavioral markers from eye tracking, we provide a detailed analysis of the neural and behavioral correlates of confusion during naturalistic reading. Using machine learning, we show that multimodal (EEG + eye tracking) models improve classification accuracy by 4-22% over unimodal baselines, reaching an average weighted participant accuracy of 77.3% and a best accuracy of 89.6%. Our results highlight the dominance of the brain's temporal regions in these neural signatures of confusion, suggesting avenues for wearable, low-electrode brain-computer interfaces (BCI) for real-time monitoring. These findings lay the foundation for developing adaptive systems that dynamically detect and respond to user confusion, with potential applications in personalized learning, human-computer interaction, and accessibility.

📄 PDF Abstract BibTeX arXiv:2508.14442

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Neural Architecture for Detecting Confusion in Eye-tracking Data

2020-03-13 · Shane Sims, Cristina Conati

Encouraged by the success of deep learning in a variety of domains, we investigate a novel application of its methods on the effectiveness of detecting user confusion in eye-tracking data. We introduce an architecture th…

SensitivitySpecificity

Factuality Checking in News Headlines with Eye Tracking

2020-06-17 · Christian Hansen, Casper Hansen, Jakob Grue Simonsen, Birger Larsen 외

We study whether it is possible to infer if a news headline is true or false using only the movement of the human eyes when reading news headlines. Our study with 55 participants who are eye-tracked when reading 108 news…

Predicting Confusion from Eye-Tracking Data with Recurrent Neural Networks

2019-06-19 · Shane D. Sims, Vanessa Putnam, Cristina Conati

Encouraged by the success of deep learning in a variety of domains, we investigate the suitability and effectiveness of Recurrent Neural Networks (RNNs) in a domain where deep learning has not yet been used; namely detec…

Data AugmentationSensitivitySpecificity

Encoding Word Confusion Networks with Recurrent Neural Networks for Dialog State Tracking

2017-07-18 · WS 2017 9 · Glorianna Jagfeld, Ngoc Thang Vu

This paper presents our novel method to encode word confusion networks, which can represent a rich hypothesis space of automatic speech recognition systems, via recurrent neural networks. We demonstrate the utility of ou…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)dialog state trackingspeech-recognition+1

AFFDEX 2.0: A Real-Time Facial Expression Analysis Toolkit

2022-02-24 · Mina Bishay, Kenneth Preston, Matthew Strafuss, Graham Page 외

In this paper we introduce AFFDEX 2.0 - a toolkit for analyzing facial expressions in the wild, that is, it is intended for users aiming to; a) estimate the 3D head pose, b) detect facial Action Units (AUs), c) recognize…