paper-with-me

홈 › Papers

Autoregressive Score Generation for Multi-trait Essay Scoring

2024-03-13 · Heejin Do, Yunsu Kim, Gary Geunbae Lee

Recently, encoder-only pre-trained models such as BERT have been successfully applied in automated essay scoring (AES) to predict a single overall score. However, studies have yet to explore these models in multi-trait AES, possibly due to the inefficiency of replicating BERT-based models for each trait. Breaking away from the existing sole use of encoder, we propose an autoregressive prediction of multi-trait scores (ArTS), incorporating a decoding process by leveraging the pre-trained T5. Unlike prior regression or classification methods, we redefine AES as a score-generation task, allowing a single model to predict multiple scores. During decoding, the subsequent trait prediction can benefit by conditioning on the preceding trait scores. Experimental results proved the efficacy of ArTS, showing over 5% average improvements in both prompts and traits.

📄 PDF Abstract BibTeX arXiv:2403.08332

Code (1)

doheejin/arts 공식 구현 pytorch

Tasks

Automated Essay Scoring

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
WordPiece 설명 없음
Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Trait-Aware Policy Optimization for Autoregressive Multi-Trait Essay Scoring

2026-05-25 · Zhengyang Wang, Sanwoo Lee, Jiaxin Wang, Chenxi Miao 외 arxiv

Multi-trait essay scoring aims to provide fine-grained evaluation of writing quality across multiple dimensions. However, how to effectively post-train autoregressive scoring models remains underexplored. In this paper, …

Decision-Level Ordinal Modeling for Multimodal Essay Scoring with Large Language Models

2026-03-16 · Han Zhang, Jiamin Su, Li liu arxiv

Automated essay scoring (AES) predicts multiple rubric-defined trait scores for each essay, where each trait follows an ordered discrete rating scale. Most LLM-based AES methods cast scoring as autoregressive token gener…

Automated Essay Scoring

Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple Rewards

2024-09-26 · Heejin Do, Sangwon Ryu, Gary Geunbae Lee

Recent advances in automated essay scoring (AES) have shifted towards evaluating multiple traits to provide enriched feedback. Like typical AES systems, multi-trait AES employs the quadratic weighted kappa (QWK) to measu…

Automated Essay Scoringreinforcement-learningReinforcement LearningReinforcement Learning (RL)

A Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoring

2026-08-28 · Shihang Yang, Sanwoo Lee, Ningning Zhao, Yunfang Wu arxiv

Multi-trait Automated Essay Scoring (AES) requires rubric-grounded reasoning across interdependent traits, rather than isolated score prediction. Existing feedback-enhanced methods often decouple feedback from scoring or…

Automated Essay Scoring

Rationale Behind Essay Scores: Enhancing S-LLM's Multi-Trait Essay Scoring with Rationale Generated by LLMs

2024-10-18 · SeongYeub Chu, JongWoo Kim, Bryan Wong, MunYong Yi

Existing automated essay scoring (AES) has solely relied on essay text without using explanatory rationales for the scores, thereby forgoing an opportunity to capture the specific aspects evaluated by rubric indicators i…

Automated Essay ScoringLanguage ModelingLanguage ModellingLarge Language Model+1