A Neural Architecture for Detecting Confusion in Eye-tracking Data
Encouraged by the success of deep learning in a variety of domains, we investigate a novel application of its methods on the effectiveness of detecting user confusion in eye-tracking data. We introduce an architecture that uses RNN and CNN sub-models in parallel to take advantage of the temporal and visuospatial aspects of our data. Experiments with a dataset of user interactions with the ValueChart visualization tool show that our model outperforms an existing model based on Random Forests resulting in a 22% improvement in combined sensitivity & specificity.
Code (0)
등록된 구현이 없습니다.
Tasks
SensitivitySpecificitySimilar Papers 제목 키워드 기반
Detecting Reading-Induced Confusion Using EEG and Eye Tracking
Humans regularly navigate an overwhelming amount of information via text media, whether reading articles, browsing social media, or interacting with chatbots. Confusion naturally arises when new information conflicts wit…
Predicting Confusion from Eye-Tracking Data with Recurrent Neural Networks
Encouraged by the success of deep learning in a variety of domains, we investigate the suitability and effectiveness of Recurrent Neural Networks (RNNs) in a domain where deep learning has not yet been used; namely detec…
Data AugmentationSensitivitySpecificityTowards Detection and Remediation of Phonemic Confusion
Reducing communication breakdown is critical to success in interactive NLP applications, such as dialogue systems. To this end, we propose a confusion-mitigation framework for the detection and remediation of communicati…
Encoding Word Confusion Networks with Recurrent Neural Networks for Dialog State Tracking
This paper presents our novel method to encode word confusion networks, which can represent a rich hypothesis space of automatic speech recognition systems, via recurrent neural networks. We demonstrate the utility of ou…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)dialog state trackingspeech-recognition+1AFFDEX 2.0: A Real-Time Facial Expression Analysis Toolkit
In this paper we introduce AFFDEX 2.0 - a toolkit for analyzing facial expressions in the wild, that is, it is intended for users aiming to; a) estimate the 3D head pose, b) detect facial Action Units (AUs), c) recognize…