Automated Essay Scoring via Pairwise Contrastive Regression
Automated essay scoring (AES) involves the prediction of a score relating to the writing quality of an essay. Most existing works in AES utilize regression objectives or ranking objectives respectively. However, the two types of methods are highly complementary. To this end, in this paper we take inspiration from contrastive learning and propose a novel unified Neural Pairwise Contrastive Regression (NPCR) model in which both objectives are optimized simultaneously as a single loss. Specifically, we first design a neural pairwise ranking model to guarantee the global ranking order in a large list of essays, and then we further extend this pairwise ranking model to predict the relative scores between an input essay and several reference essays. Additionally, a multi-sample voting strategy is employed for inference. We use Quadratic Weighted Kappa to evaluate our model on the public Automated Student Assessment Prize (ASAP) dataset, and the experimental results demonstrate that NPCR outperforms previous methods by a large margin, achieving the state-of-the-art average performance for the AES task.
Code (1)
Tasks
Automated Essay ScoringContrastive LearningregressionSimilar Papers 제목 키워드 기반
Mitigating Bias in Automated Grading Systems for ESL Learners: A Contrastive Learning Approach
As Automated Essay Scoring (AES) systems are increasingly used in high-stakes educational settings, concerns regarding algorithmic bias against English as a Second Language (ESL) learners have increased. Current Transfor…
Automated Essay ScoringContrastive LearningLCES: Zero-shot Automated Essay Scoring via Pairwise Comparisons Using Large Language Models
Recent advances in large language models (LLMs) have enabled zero-shot automated essay scoring (AES), providing a promising way to reduce the cost and effort of essay scoring in comparison with manual grading. However, m…
Automated Essay ScoringComputational EfficiencyRegression or classification? Automated Essay Scoring for Norwegian
In this paper we present first results for the task of Automated Essay Scoring for Norwegian learner language. We analyze a number of properties of this task experimentally and assess (i) the formulation of the task as e…
Automated Essay ScoringBIG-bench Machine LearningClassificationGeneral Classification+4Pair2Score: Pairwise-to-Absolute Transfer for LLM-Based Essay Scoring
Many scoring applications require absolute predictions, while pairwise comparisons can provide a simpler learning objective. We present Pair2Score, a two-stage learning framework that transfers pairwise comparisons into …
Automated Essay ScoringThe Effectiveness of a Dynamic Loss Function in Neural Network Based Automated Essay Scoring
Neural networks and in particular the attention mechanism have brought significant advances to the field of Automated Essay Scoring. Many of these systems use a regression-based model which may be prone to underfitting w…
Automated Essay Scoringregression