paper-with-me

홈 › Papers

Using Linguistic Features to Predict the Response Process Complexity Associated with Answering Clinical MCQs

2021-04-01 · EACL (BEA) 2021 4 · Victoria Yaneva, Daniel Jurich, Le An Ha, Peter Baldwin

This study examines the relationship between the linguistic characteristics of a test item and the complexity of the response process required to answer it correctly. Using data from a large-scale medical licensing exam, clustering methods identified items that were similar with respect to their relative difficulty and relative response-time intensiveness to create low response process complexity and high response process complexity item classes. Interpretable models were used to investigate the linguistic features that best differentiated between these classes from a descriptive and predictive framework. Results suggest that nuanced features such as the number of ambiguous medical terms help explain response process complexity beyond superficial item characteristics such as word count. Yet, although linguistic features carry signal relevant to response process complexity, the classification of individual items remains challenging.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringDescriptive

Similar Papers 제목 키워드 기반

Synthetic Student Responses: LLM-Extracted Features for IRT Difficulty Parameter Estimation

2026-01-18 · Matias Hoyl arxiv

Educational assessment relies heavily on knowing question difficulty, traditionally determined through resource-intensive pre-testing with students. This creates significant barriers for both classroom teachers and asses…

Linguistic Features of Sarcasm and Metaphor Production Quality

2018-06-01 · WS 2018 6 · Stephen Skalicky, Scott Crossley

Using linguistic features to detect figurative language has provided a deeper in-sight into figurative language. The purpose of this study is to assess whether linguistic features can help explain differences in quality …

Language Identification

Fine-tuning ChatGPT for Automatic Scoring of Written Scientific Explanations in Chinese

2025-01-12 · Jie Yang, Ehsan Latif, Yuze He, Xiaoming Zhai

The development of explanations for scientific phenomena is essential in science assessment, but scoring student-written explanations remains challenging and resource-intensive. Large language models (LLMs) have shown pr…

LCP-RIT at SemEval-2021 Task 1: Exploring Linguistic Features for Lexical Complexity Prediction

2021-05-18 · SEMEVAL 2021 · Abhinandan Desai, Kai North, Marcos Zampieri, Christopher M. Homan

This paper describes team LCP-RIT's submission to the SemEval-2021 Task 1: Lexical Complexity Prediction (LCP). The task organizers provided participants with an augmented version of CompLex (Shardlow et al., 2020), an E…

Lexical Complexity PredictionPOSregression

Automated assessment of non-native learner essays: Investigating the role of linguistic features

2016-12-02 · Sowmya Vajjala

Automatic essay scoring (AES) refers to the process of scoring free text responses to given prompts, considering human grader scores as the gold standard. Writing such essays is an essential component of many language an…