Papers Automated Essay Scoring
“Automated Essay Scoring” 태그가 달린 논문 154편 · 필터 해제
The Role of Implicit and Explicit Demographic Signals in Large Language Model-based Student Assessment
Large Language Models are now common in student assessment, but we know little about how student demographics affect their use. Sometimes, considering student demographics may be necessary -- for example, to improve read…
Automated Essay ScoringQuestion AnsweringA Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoring
Multi-trait Automated Essay Scoring (AES) requires rubric-grounded reasoning across interdependent traits, rather than isolated score prediction. Existing feedback-enhanced methods often decouple feedback from scoring or…
Automated Essay ScoringArguLens: An Open-Source System for Automated Essay Scoring and Label-Aware Feedback Generation
Most automated essay scoring (AES) systems output a single holistic score without interpretable evidence and rely on closed APIs that introduce data privacy and cost barriers. We present ArguLens, an opensource, locally …
Automated Essay ScoringICLE++: Modeling Fine-Grained Traits for Holistic Essay Scoring
The majority of the recently-developed models for automated essay scoring (AES) are evaluated solely on the ASAP corpus. However, ASAP is not without its limitations. For instance, it is not clear whether models trained …
Automated Essay ScoringCost-efficient generative AI summarization for scalable automated essay scoring in educational assessment
Automated essay scoring (AES) enables scalable assessment and timely feedback but remains challenged by transformer input-length limitations, which can cause information loss when processing long essays. This study propo…
Automated Essay ScoringSemantic SimilarityInvestigating first-language bias in LLM-based automated essay scoring: A cross-prompt evaluation of an open-weight AI-model on TOEFL essays
This study examines the cross-prompt generalization and first-language (L1) scoring effects of a LoRA-adapted open-weight large language model (Gemma-3-27B-it) applied to automated essay scoring. Using the identical mode…
Automated Essay ScoringDemographic Metadata as Construct-Irrelevant Noise in DistilBERT-Based Automated Essay Scoring
Automated Essay Scoring (AES) systems are increasingly used to support teachers in managing grading workloads and to provide a supplementary rater in large-scale assessments. While human grading is frequently influenced …
Automated Essay ScoringFrom Texts to Scores: Tracing the Emergence of Essay Quality Representations in Large Language Models
Recent advances in Large Language Models (LLMs) have substantially transformed Automated Essay Scoring (AES), yet the internal mechanisms underlying LLM-based scoring remain poorly understood. In this work, we systematic…
Dimensionality ReductionAutomated Essay ScoringPsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedback
Effective Automated Essay Scoring (AES) are expected to support both reliable assessment and actionable instructional feedback. However, existing approaches often treat scoring and feedback as separate components: neural…
Automated Essay ScoringThe Order Matters: Sequential Fine-Tuning of LLaMA for Coherent Automated Essay Scoring
Automated Essay Scoring (AES) systems must judge interdependent discourse elements (e.g., lead, claim, evidence, conclusion), yet most approaches treat these in isolation, harming coherence and generalization. We investi…
Automated Essay ScoringAutomated Essay Scoring and Language Certification: Assessing Generalizability, Agreement and Validity for French
In Automated Essay Scoring (AES), benchmarking practices have fostered minimalist evaluation practices, in contrast with the broader-view recommendations of evaluation frameworks, such as the argument-based validation fr…
Automated Essay ScoringDoes Continued Pretraining on a Learner Corpus Improve Automated Essay Scoring on English Proficiency Tests? Evidence from EFCAMDAT
Automated Essay Scoring (AES) for English proficiency assessment increasingly relies on pretrained transformer models, yet these models are typically trained on general-domain English and may under-represent second-langu…
Automated Essay ScoringTowards Robust Argumentative Essay Understanding via TIDE: An Interactive Framework with Trial and Debate
Argumentative essays serve as a vital medium for assessing critical thinking and reasoning skills, yet there is limited works on accurately understanding and evaluating such texts via prompt. In this work, we propose TID…
Automated Essay ScoringTowards Self-Referential Analytic Assessment: A Profile-Based Approach to L2 Writing Evaluation with LLMs
Automated essay scoring (AES) research often relies on rank-based correlation metrics to validate analytic assessment. However, such metrics obscure both intrinsic intercorrelations among analytic dimensions that arise f…
Automated Essay ScoringPair2Score: Pairwise-to-Absolute Transfer for LLM-Based Essay Scoring
Many scoring applications require absolute predictions, while pairwise comparisons can provide a simpler learning objective. We present Pair2Score, a two-stage learning framework that transfers pairwise comparisons into …
Automated Essay ScoringHas Automated Essay Scoring Reached Sufficient Accuracy? Deriving Achievable QWK Ceilings from Classical Test Theory
Automated essay scoring (AES) is commonly evaluated on public benchmarks using quadratic weighted kappa (QWK). However, because benchmark labels are assigned by human raters and inevitably contain scoring errors, it rema…
Automated Essay ScoringMAPLE: A Meta-learning Framework for Cross-Prompt Essay Scoring
Automated Essay Scoring (AES) faces significant challenges in cross-prompt settings, where models must generalize to unseen writing prompts. To address this limitation, we propose MAPLE, a meta-learning framework that le…
Automated Essay ScoringChinese Essay Rhetoric Recognition Using LoRA, In-context Learning and Model Ensemble
Rhetoric recognition is a critical component in automated essay scoring. By identifying rhetorical elements in student writing, AI systems can better assess linguistic and higher-order thinking skills, making it an essen…
Automated Essay ScoringLLMs Do Not Grade Essays Like Humans
Large language models have recently been proposed as tools for automated essay scoring, but their agreement with human grading remains unclear. In this work, we evaluate how LLM-generated scores compare with human grades…
Automated Essay ScoringDecision-Level Ordinal Modeling for Multimodal Essay Scoring with Large Language Models
Automated essay scoring (AES) predicts multiple rubric-defined trait scores for each essay, where each trait follows an ordered discrete rating scale. Most LLM-based AES methods cast scoring as autoregressive token gener…
Automated Essay Scoring