paper-with-me

Papers

Automatic Essay Multi-dimensional Scoring with Fine-tuning and Multiple Regression

2024-06-03 · Kun Sun, Rong Wang

Automated essay scoring (AES) involves predicting a score that reflects the writing quality of an essay. Most existing AES systems produce only a single overall score. However, users and L2 learners expect scores across different dimensions (e.g., vocabulary, grammar, coherence) for English essays in real-world applications. To address this need, we have developed two models that automatically score English essays across multiple dimensions by employing fine-tuning and other strategies on two large datasets. The results demonstrate that our systems achieve impressive performance in evaluation using three criteria: precision, F1 score, and Quadratic Weighted Kappa. Furthermore, our system outperforms existing methods in overall scoring.

📄 PDF Abstract BibTeX arXiv:2406.01198

Code (0)

등록된 구현이 없습니다.

Tasks

Automated Essay Scoringregression

Similar Papers 제목 키워드 기반

Fine-grained essay scoring of a complex writing task for native speakers

2017-09-01 · WS 2017 9 · Andrea Horbach, Dirk Scholten-Akoun, Yuning Ding, Torsten Zesch

Automatic essay scoring is nowadays successfully used even in high-stakes tests, but this is mainly limited to holistic scoring of learner essays. We present a new dataset of essays written by highly proficient German na…

Many Hands Make Light Work: Using Essay Traits to Automatically Score Essays

2021-02-01 · NAACL 2022 7 · Rahul Kumar, Sandeep Mathias, Sriparna Saha, Pushpak Bhattacharyya

Most research in the area of automatic essay grading (AEG) is geared towards scoring the essay holistically while there has also been some work done on scoring individual essay traits. In this paper, we describe a way to…

Automated Essay ScoringMulti-Task Learning

Automatic Essay Scoring Incorporating Rating Schema via Reinforcement Learning

2018-10-01 · EMNLP 2018 10 · Yucheng Wang, Zhongyu Wei, Yaqian Zhou, Xuanjing Huang

Automatic essay scoring (AES) is the task of assigning grades to essays without human interference. Existing systems for AES are typically trained to predict the score of each single essay at a time without considering t…

Machine Translationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+2

Can Neural Networks Automatically Score Essay Traits?

2020-07-01 · WS 2020 7 · S Mathias, eep, Pushpak Bhattacharyya

Essay traits are attributes of an essay that can help explain how well written (or badly written) the essay is. Examples of traits include Content, Organization, Language, Sentence Fluency, Word Choice, etc. A lot of res…

BIG-bench Machine LearningSentence

Automated Chinese Essay Scoring from Multiple Traits

2022-10-01 · COLING 2022 10 · Yaqiong He, Feng Jiang, Xiaomin Chu, Peifeng Li

Automatic Essay Scoring (AES) is the task of using the computer to evaluate the quality of essays automatically. Current research on AES focuses on scoring the overall quality or single trait of prompt-specific essays. H…