paper-with-me

홈 › Papers

A Prompt-independent and Interpretable Automated Essay Scoring Method for Chinese Second Language Writing

2021-08-01 · CCL 2021 8 · Wang Yupei, Hu Renfen

“With the increasing popularity of learning Chinese as a second language (L2) the development of an automatic essay scoring (AES) method specially for Chinese L2 essays has become animportant task. To build a robust model that could easily adapt to prompt changes we propose 90linguistic features with consideration of both language complexity and correctness and introducethe Ordinal Logistic Regression model that explicitly combines these linguistic features and low-level textual representations. Our model obtains a high QWK of 0.714 a low RMSE of 1.516 anda considerable Pearson correlation of 0.734. With a simple linear model we further analyze the contribution of the linguistic features to score prediction revealing the model’s interpretability and its potential to give writing feedback to users. This work provides insights and establishes asolid baseline for Chinese L2 AES studies.”

📄 PDF Abstract BibTeX

Code (1)

iris2hu/l2c-rater 공식 구현 tf

Tasks

Automated Essay Scoring

Similar Papers 제목 키워드 기반

TDNN: A Two-stage Deep Neural Network for Prompt-independent Automated Essay Scoring

2018-07-01 · ACL 2018 7 · Cancan Jin, Ben He, Kai Hui, Le Sun

Existing automated essay scoring (AES) models rely on rated essays for the target prompt as training data. Despite their successes in prompt-dependent AES, how to effectively predict essay ratings under a prompt-independ…

Automated Essay Scoring

Empirical Study of Large Language Models as Automated Essay Scoring Tools in English Composition__Taking TOEFL Independent Writing Task for Example

2024-01-07 · Wei Xia, Shaoguang Mao, Chanjing Zheng

Large language models have demonstrated exceptional capabilities in tasks involving natural language generation, reasoning, and comprehension. This study aims to construct prompts and comments grounded in the diverse sco…

Automated Essay ScoringPrompt LearningText Generation

ArguLens: An Open-Source System for Automated Essay Scoring and Label-Aware Feedback Generation

2026-08-18 · Weiran Wang, Hongxiang Shi, Huitao Tang, Wenjuan Qin arxiv

Most automated essay scoring (AES) systems output a single holistic score without interpretable evidence and rely on closed APIs that introduce data privacy and cost barriers. We present ArguLens, an opensource, locally …

Automated Essay Scoring

Exploration of Summarization by Generative Language Models for Automated Scoring of Long Essays

2025-10-26 · Haowei Hua, Hong Jiao, Xinyi Wang arxiv

BERT and its variants are extensively explored for automated scoring. However, a limit of 512 tokens for these encoder-based models showed the deficiency in automated scoring of long essays. Thus, this research explores …

Automated Essay Scoring

Investigating first-language bias in LLM-based automated essay scoring: A cross-prompt evaluation of an open-weight AI-model on TOEFL essays

2026-07-16 · John Maurice Gayed arxiv

This study examines the cross-prompt generalization and first-language (L1) scoring effects of a LoRA-adapted open-weight large language model (Gemma-3-27B-it) applied to automated essay scoring. Using the identical mode…

Automated Essay Scoring