Automatic Essay Scoring Incorporating Rating Schema via Reinforcement Learning
Automatic essay scoring (AES) is the task of assigning grades to essays without human interference. Existing systems for AES are typically trained to predict the score of each single essay at a time without considering the rating schema. In order to address this issue, we propose a reinforcement learning framework for essay scoring that incorporates quadratic weighted kappa as guidance to optimize the scoring system. Experiment results on benchmark datasets show the effectiveness of our framework.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine Translationreinforcement-learningReinforcement LearningReinforcement Learning (RL)Relation ClassificationText GenerationSimilar Papers 제목 키워드 기반
Improve LLM-based Automatic Essay Scoring with Linguistic Features
Automatic Essay Scoring (AES) assigns scores to student essays, reducing the grading workload for instructors. Developing a scoring system capable of handling essays across diverse prompts is challenging due to the flexi…
Language ModelingLanguage ModellingLarge Language ModelAutomated Essay Scoring Incorporating Annotations from Automated Feedback Systems
This study illustrates how incorporating feedback-oriented annotations into the scoring pipeline can enhance the accuracy of automated essay scoring (AES). This approach is demonstrated with the Persuasive Essays for Rat…
Automated Essay ScoringLanguage ModelingLanguage ModellingCan generative AI figure out figurative language? The influence of idioms on essay scoring by ChatGPT, Gemini, and Deepseek
The developments in Generative AI technologies have paved the way for numerous innovations in different fields. Recently, Generative AI has been proposed as a competitor to AES systems in evaluating student essays automa…
Attention-based Recurrent Convolutional Neural Network for Automatic Essay Scoring
Neural network models have recently been applied to the task of automatic essay scoring, giving promising results. Existing work used recurrent neural networks and convolutional neural networks to model input essays, giv…
Feature EngineeringMachine TranslationSentenceSentiment AnalysisNeural Automated Essay Scoring Incorporating Handcrafted Features
Automated essay scoring (AES) is the task of automatically assigning scores to essays as an alternative to grading by human raters. Conventional AES typically relies on handcrafted features, whereas recent studies have p…
Automated Essay ScoringFeature EngineeringSentence