Multi-task Learning for Automated Essay Scoring with Sentiment Analysis
Automated Essay Scoring (AES) is a process that aims to alleviate the workload of graders and improve the feedback cycle in educational systems. Multi-task learning models, one of the deep learning techniques that have recently been applied to many NLP tasks, demonstrate the vast potential for AES. In this work, we present an approach for combining two tasks, sentiment analysis, and AES by utilizing multi-task learning. The model is based on a hierarchical neural network that learns to predict a holistic score at the document-level along with sentiment classes at the word-level and sentence-level. The sentiment features extracted from opinion expressions can enhance a vanilla holistic essay scoring, which mainly focuses on lexicon and text semantics. Our approach demonstrates that sentiment features are beneficial for some essay prompts, and the performance is competitive to other deep learning models on the Automated StudentAssessment Prize (ASAP) benchmark. TheQuadratic Weighted Kappa (QWK) is used to measure the agreement between the human grader{'}s score and the model{'}s prediction. Ourmodel produces a QWK of 0.763.
Code (0)
등록된 구현이 없습니다.
Tasks
Automated Essay ScoringMulti-Task LearningSentenceSentiment AnalysisSimilar Papers 제목 키워드 기반
Review of feedback in Automated Essay Scoring
The first automated essay scoring system was developed 50 years ago. Automated essay scoring systems are developing into systems with richer functions than the previous simple scoring systems. Its purpose is not only to …
Automated Essay ScoringNeural Multi-task Learning in Automated Assessment
Grammatical error detection and automated essay scoring are two tasks in the area of automated assessment. Traditionally these tasks have been treated independently with different machine learning models and features use…
Automated Essay ScoringBIG-bench Machine LearningGrammatical Error DetectionMulti-Task LearningInvestigating neural architectures for short answer scoring
Neural approaches to automated essay scoring have recently shown state-of-the-art performance. The automated essay scoring task typically involves a broad notion of writing quality that encompasses content, grammar, orga…
Automated Essay ScoringReading ComprehensionWord EmbeddingsExploration of Summarization by Generative Language Models for Automated Scoring of Long Essays
BERT and its variants are extensively explored for automated scoring. However, a limit of 512 tokens for these encoder-based models showed the deficiency in automated scoring of long essays. Thus, this research explores …
Automated Essay ScoringImproving Performance of Automated Essay Scoring by using back-translation essays and adjusted scores
Automated essay scoring plays an important role in judging students' language abilities in education. Traditional approaches use handcrafted features to score and are time-consuming and complicated. Recently, neural netw…
Automated Essay ScoringFeature Engineering