Automatic learner summary assessment for reading comprehension
Automating the assessment of learner summaries provides a useful tool for assessing learner reading comprehension. We present a summarization task for evaluating non-native reading comprehension and propose three novel approaches to automatically assess the learner summaries. We evaluate our models on two datasets we created and show that our models outperform traditional approaches that rely on exact word match on this task. Our best model produces quality assessments close to professional examiners.
Code (0)
등록된 구현이 없습니다.
Tasks
Reading ComprehensionSimilar Papers 제목 키워드 기반
A Framework for Learning Assessment through Multimodal Analysis of Reading Behaviour and Language Comprehension
Reading comprehension, which has been defined as gaining an understanding of written text through a process of translating grapheme into meaning, is an important academic skill. Other language learning skills - writing, …
Reading ComprehensionUsing Analytic Scoring Rubrics in the Automatic Assessment of College-Level Summary Writing Tasks in L2
Assessing summaries is a demanding, yet useful task which provides valuable information on language competence, especially for second language learners. We consider automated scoring of college-level summary writing task…
Reading ComprehensionregressionChatPRCS: A Personalized Support System for English Reading Comprehension based on ChatGPT
As a common approach to learning English, reading comprehension primarily entails reading articles and answering related questions. However, the complexity of designing effective exercises results in students encounterin…
ArticlesQuestion GenerationQuestion-GenerationReading ComprehensionQuestion Generation for Assessing Early Literacy Reading Comprehension
Assessment of reading comprehension through content-based interactions plays an important role in the reading acquisition process. In this paper, we propose a novel approach for generating comprehension questions geared …
Reading ComprehensionQuestion GenerationOn Understanding the Relation between Expert Annotations of Text Readability and Target Reader Comprehension
Automatic readability assessment aims to ensure that readers read texts that they can comprehend. However, computational models are typically trained on texts created from the perspective of the text writer, not the targ…
Question GenerationQuestion-GenerationReading ComprehensionRelation