paper-with-me

홈 › Papers

Neural Automated Essay Scoring Incorporating Handcrafted Features

2020-12-01 · COLING 2020 8 · Masaki Uto, Yikuan Xie, Maomi Ueno

Automated essay scoring (AES) is the task of automatically assigning scores to essays as an alternative to grading by human raters. Conventional AES typically relies on handcrafted features, whereas recent studies have proposed AES models based on deep neural networks (DNNs) to obviate the need for feature engineering. Furthermore, hybrid methods that integrate handcrafted features in a DNN-AES model have been recently developed and have achieved state-of-the-art accuracy. One of the most popular hybrid methods is formulated as a DNN-AES model with an additional recurrent neural network (RNN) that processes a sequence of handcrafted sentence-level features. However, this method has the following problems: 1) It cannot incorporate effective essay-level features developed in previous AES research. 2) It greatly increases the numbers of model parameters and tuning parameters, increasing the difficulty of model training. 3) It has an additional RNN to process sentence-level features, enabling extension to various DNN-AES models complex. To resolve these problems, we propose a new hybrid method that integrates handcrafted essay-level features into a DNN-AES model. Specifically, our method concatenates handcrafted essay-level features to a distributed essay representation vector, which is obtained from an intermediate layer of a DNN-AES model. Our method is a simple DNN-AES extension, but significantly improves scoring accuracy.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Automated Essay ScoringFeature EngineeringSentence

Similar Papers 제목 키워드 기반

Improving Performance of Automated Essay Scoring by using back-translation essays and adjusted scores

2022-03-01 · You-Jin Jong, Yong-Jin Kim, Ok-Chol Ri

Automated essay scoring plays an important role in judging students' language abilities in education. Traditional approaches use handcrafted features to score and are time-consuming and complicated. Recently, neural netw…

Automated Essay ScoringFeature Engineering

EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models

2025-02-17 · Jiamin Su, Yibo Yan, Fangteng Fu, Han Zhang 외

Automated Essay Scoring (AES) plays a crucial role in educational assessment by providing scalable and consistent evaluations of writing tasks. However, traditional AES systems face three major challenges: (1) reliance o…

Automated Essay ScoringFeature EngineeringSentence

Automated Essay Scoring Incorporating Annotations from Automated Feedback Systems

2025-05-28 · Christopher Ormerod

This study illustrates how incorporating feedback-oriented annotations into the scoring pipeline can enhance the accuracy of automated essay scoring (AES). This approach is demonstrated with the Persuasive Essays for Rat…

Automated Essay ScoringLanguage ModelingLanguage Modelling

Evaluating Austrian A-Level German Essays with Large Language Models for Automated Essay Scoring

2026-03-06 · Jonas Kubesch, Lena Huber, Clemens Havas arxiv

Automated Essay Scoring (AES) has been explored for decades with the goal to support teachers by reducing grading workload and mitigating subjective biases. While early systems relied on handcrafted features and statisti…

Automated Essay Scoring

Cost-efficient generative AI summarization for scalable automated essay scoring in educational assessment

2026-07-17 · Haowei Hua arxiv

Automated essay scoring (AES) enables scalable assessment and timely feedback but remains challenged by transformer input-length limitations, which can cause information loss when processing long essays. This study propo…

Automated Essay ScoringSemantic Similarity