paper-with-me

홈 › Papers

A Framework for Learning Assessment through Multimodal Analysis of Reading Behaviour and Language Comprehension

2021-10-22 · Santosh Kumar Barnwal

Reading comprehension, which has been defined as gaining an understanding of written text through a process of translating grapheme into meaning, is an important academic skill. Other language learning skills - writing, speaking and listening, all are connected to reading comprehension. There have been several measures proposed by researchers to automate the assessment of comprehension skills for second language (L2) learners, especially English as Second Language (ESL) and English as Foreign Language (EFL) learners. However, current methods measure particular skills without analysing the impact of reading frequency on comprehension skills. In this dissertation, we show how different skills could be measured and scored automatically. We also demonstrate, using example experiments on multiple forms of learners' responses, how frequent reading practices could impact on the variables of multimodal skills (reading pattern, writing, and oral fluency). This thesis comprises of five studies. The first and second studies are based on eye-tracking data collected from EFL readers in repeated reading (RR) sessions. The third and fourth studies are to evaluate free-text summary written by EFL readers in repeated reading sessions. The fifth and last study, described in the sixth chapter of the thesis, is to evaluate recorded oral summaries recited by EFL readers in repeated reading sessions. In a nutshell, through this dissertation, we show that multimodal skills of learners could be assessed to measure their comprehension skills as well as to measure the effect of repeated readings on these skills in the course of time, by finding significant features and by applying machine learning techniques with a combination of statistical models such as LMER.

📄 PDF Abstract BibTeX arXiv:2110.11938

Code (0)

등록된 구현이 없습니다.

Tasks

Reading Comprehension

Similar Papers 제목 키워드 기반

LLMs as Educational Analysts: Transforming Multimodal Data Traces into Actionable Reading Assessment Reports

2025-03-03 · Eduardo Davalos, Yike Zhang, Namrata Srivastava, Jorge Alberto Salas 외

Reading assessments are essential for enhancing students' comprehension, yet many EdTech applications focus mainly on outcome-based metrics, providing limited insights into student behavior and cognition. This study inve…

FairnessLanguage ModelingLanguage ModellingLarge Language Model

Building an ASR Solution for Training and Assessing Children's Reading

2026-06-30 · Yacouba Diarra, Nouhoum Souleymane Coulibaly, Mamadou Dembele, Aymane Dembele 외 arxiv

Automatic speech recognition for children's reading remains underdeveloped for most African languages, including Bambara, despite its potential value for reproducible literacy assessment. We present an open-source system…

Speech Recognition

Robust Multilingual Text-to-Pictogram Mapping for Scalable Reading Rehabilitation

2026-03-25 · Soufiane Jhilal, Martina Galletti arxiv

Reading comprehension presents a significant challenge for children with Special Educational Needs and Disabilities (SEND), often requiring intensive one-on-one reading support. To assist therapists in scaling this suppo…

Reading Comprehension

M&M: Multimodal-Multitask Model Integrating Audiovisual Cues in Cognitive Load Assessment

2024-03-14 · Long Nguyen-Phuoc, Renald Gaboriau, Dimitri Delacroix, Laurent Navarro

This paper introduces the M&M model, a novel multimodal-multitask learning framework, applied to the AVCAffe dataset for cognitive load assessment (CLA). M&M uniquely integrates audiovisual cues through a dual-pathway ar…

Automatic Assessment of Oral Reading Accuracy for Reading Diagnostics

2023-06-06 · Bo Molenaar, Cristian Tejedor-Garcia, Helmer Strik, Catia Cucchiarini

Automatic assessment of reading fluency using automatic speech recognition (ASR) holds great potential for early detection of reading difficulties and subsequent timely intervention. Precise assessment tools are required…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+2