paper-with-me

홈 › Papers

TDNN: A Two-stage Deep Neural Network for Prompt-independent Automated Essay Scoring

2018-07-01 · ACL 2018 7 · Cancan Jin, Ben He, Kai Hui, Le Sun

Existing automated essay scoring (AES) models rely on rated essays for the target prompt as training data. Despite their successes in prompt-dependent AES, how to effectively predict essay ratings under a prompt-independent setting remains a challenge, where the rated essays for the target prompt are not available. To close this gap, a two-stage deep neural network (TDNN) is proposed. In particular, in the first stage, using the rated essays for non-target prompts as the training data, a shallow model is learned to select essays with an extreme quality for the target prompt, serving as pseudo training data; in the second stage, an end-to-end hybrid deep model is proposed to learn a prompt-dependent rating model consuming the pseudo training data from the first step. Evaluation of the proposed TDNN on the standard ASAP dataset demonstrates a promising improvement for the prompt-independent AES task.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Automated Essay Scoring

Similar Papers 제목 키워드 기반

Prompt Agnostic Essay Scorer: A Domain Generalization Approach to Cross-prompt Automated Essay Scoring

2020-08-04 · Robert Ridley, Liang He, Xin-yu Dai, Shu-Jian Huang 외

Cross-prompt automated essay scoring (AES) requires the system to use non target-prompt essays to award scores to a target-prompt essay. Since obtaining a large quantity of pre-graded essays to a particular prompt is oft…

Automated Essay ScoringDomain GeneralizationTransfer Learning

Empirical Study of Large Language Models as Automated Essay Scoring Tools in English Composition__Taking TOEFL Independent Writing Task for Example

2024-01-07 · Wei Xia, Shaoguang Mao, Chanjing Zheng

Large language models have demonstrated exceptional capabilities in tasks involving natural language generation, reasoning, and comprehension. This study aims to construct prompts and comments grounded in the diverse sco…

Automated Essay ScoringPrompt LearningText Generation

Multi-Stage Pre-training for Automated Chinese Essay Scoring

2020-11-01 · EMNLP 2020 11 · Wei Song, Kai Zhang, Ruiji Fu, Lizhen Liu 외

This paper proposes a pre-training based automated Chinese essay scoring method. The method involves three components: weakly supervised pre-training, supervised cross- prompt fine-tuning and supervised target- prompt fi…

Domain Adaptation

Automated Essay Scoring based on Two-Stage Learning

2019-01-23 · Jiawei Liu, Yang Xu, Yaguang Zhu

Current state-of-art feature-engineered and end-to-end Automated Essay Score (AES) methods are proven to be unable to detect adversarial samples, e.g. the essays composed of permuted sentences and the prompt-irrelevant e…

Automated Essay ScoringVocal Bursts Valence Prediction

Investigating first-language bias in LLM-based automated essay scoring: A cross-prompt evaluation of an open-weight AI-model on TOEFL essays

2026-07-16 · John Maurice Gayed arxiv

This study examines the cross-prompt generalization and first-language (L1) scoring effects of a LoRA-adapted open-weight large language model (Gemma-3-27B-it) applied to automated essay scoring. Using the identical mode…

Automated Essay Scoring