Automatic Essay Multi-dimensional Scoring with Fine-tuning and Multiple Regression
Automated essay scoring (AES) involves predicting a score that reflects the writing quality of an essay. Most existing AES systems produce only a single overall score. However, users and L2 learners expect scores across different dimensions (e.g., vocabulary, grammar, coherence) for English essays in real-world applications. To address this need, we have developed two models that automatically score English essays across multiple dimensions by employing fine-tuning and other strategies on two large datasets. The results demonstrate that our systems achieve impressive performance in evaluation using three criteria: precision, F1 score, and Quadratic Weighted Kappa. Furthermore, our system outperforms existing methods in overall scoring.
Code (0)
등록된 구현이 없습니다.
Tasks
Automated Essay ScoringregressionSimilar Papers 제목 키워드 기반
Fine-grained essay scoring of a complex writing task for native speakers
Automatic essay scoring is nowadays successfully used even in high-stakes tests, but this is mainly limited to holistic scoring of learner essays. We present a new dataset of essays written by highly proficient German na…
Many Hands Make Light Work: Using Essay Traits to Automatically Score Essays
Most research in the area of automatic essay grading (AEG) is geared towards scoring the essay holistically while there has also been some work done on scoring individual essay traits. In this paper, we describe a way to…
Automated Essay ScoringMulti-Task LearningAutomatic Essay Scoring Incorporating Rating Schema via Reinforcement Learning
Automatic essay scoring (AES) is the task of assigning grades to essays without human interference. Existing systems for AES are typically trained to predict the score of each single essay at a time without considering t…
Machine Translationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+2Can Neural Networks Automatically Score Essay Traits?
Essay traits are attributes of an essay that can help explain how well written (or badly written) the essay is. Examples of traits include Content, Organization, Language, Sentence Fluency, Word Choice, etc. A lot of res…
BIG-bench Machine LearningSentenceAutomated Chinese Essay Scoring from Multiple Traits
Automatic Essay Scoring (AES) is the task of using the computer to evaluate the quality of essays automatically. Current research on AES focuses on scoring the overall quality or single trait of prompt-specific essays. H…