Entropy as a Proxy for Gap Complexity in Open Cloze Tests
This paper presents a pilot study of entropy as a measure of gap complexity in open cloze tests aimed at learners of English. Entropy is used to quantify the information content in each gap, which can be used to estimate complexity. Our study shows that average gap entropy correlates positively with proficiency levels while individual gap entropy can capture contextual complexity. To the best of our knowledge, this is the first unsupervised information-theoretical approach to evaluating the quality of cloze tests.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
CEPOC: The Cambridge Exams Publishing Open Cloze dataset
Open cloze tests are a standard type of exercise where examinees must complete a text by filling in the gaps without any given options to choose from. This paper presents the Cambridge Exams Publishing Open Cloze (CEPOC)…
text-classificationText ClassificationConstructing Open Cloze Tests Using Generation and Discrimination Capabilities of Transformers
This paper presents the first multi-objective transformer model for constructing open cloze tests that exploits generation and discrimination capabilities to improve performance. Our model is further enhanced by tweaking…
Overall - TestRe-RankingVideo Cloze Procedure for Self-Supervised Spatio-Temporal Learning
We propose a novel self-supervised method, referred to as Video Cloze Procedure (VCP), to learn rich spatial-temporal representations. VCP first generates "blanks" by withholding video clips and then creates "options" by…
Action RecognitionRepresentation LearningRetrievalSelf-Supervised Action Recognition+3TempCloze: Can Video-LLMs Identify the Missing Middle?
Temporal reasoning benchmarks for Video-LLMs are often mediated by language, leaving room for linguistic shortcuts from option wording, answer correlations, or language priors. To reduce such shortcuts, we introduce Temp…
Controlling Cloze-test Question Item Difficulty with PLM-based Surrogate Models for IRT Assessment
Item difficulty plays a crucial role in adaptive testing. However, few works have focused on generating questions of varying difficulty levels, especially for multiple-choice (MC) cloze tests. We propose training pre-tra…
Cloze TestMultiple-choice