paper-with-me

Papers

Improving the Generalization Ability in Essay Coherence Evaluation through Monotonic Constraints

2023-07-25 · Chen Zheng, huan zhang, Yan Zhao, Yuxuan Lai

Coherence is a crucial aspect of evaluating text readability and can be assessed through two primary factors when evaluating an essay in a scoring scenario. The first factor is logical coherence, characterized by the appropriate use of discourse connectives and the establishment of logical relationships between sentences. The second factor is the appropriateness of punctuation, as inappropriate punctuation can lead to confused sentence structure. To address these concerns, we propose a coherence scoring model consisting of a regression model with two feature extractors: a local coherence discriminative model and a punctuation correction model. We employ gradient-boosting regression trees as the regression model and impose monotonicity constraints on the input features. The results show that our proposed model better generalizes unseen data. The model achieved third place in track 1 of NLPCC 2023 shared task 7. Additionally, we briefly introduce our solution for the remaining tracks, which achieves second place for track 2 and first place for both track 3 and track 4.

📄 PDF Abstract BibTeX arXiv:2308.02506

Code (0)

등록된 구현이 없습니다.

Tasks

Coherence EvaluationregressionSentence

Similar Papers 제목 키워드 기반

S-GRADES -- Studying Generalization of Student Response Assessments in Diverse Evaluative Settings

2026-03-10 · Tasfia Seuti, Sagnik Ray Choudhury arxiv

Evaluating student responses, from long essays to short factual answers, is a key challenge in educational NLP. Automated Essay Scoring (AES) focuses on holistic writing qualities such as coherence and argumentation, whi…

Automated Essay Scoring

Evaluation of ChatGPT Feedback on ELL Writers' Coherence and Cohesion

2023-10-10 · Su-Youn Yoon, Eva Miszoglad, Lisa R. Pierce

Since its launch in November 2022, ChatGPT has had a transformative effect on education where students are using it to help with homework assignments and teachers are actively employing it in their teaching practices. Th…

Sentence

EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models

2025-02-17 · Jiamin Su, Yibo Yan, Fangteng Fu, Han Zhang 외

Automated Essay Scoring (AES) plays a crucial role in educational assessment by providing scalable and consistent evaluations of writing tasks. However, traditional AES systems face three major challenges: (1) reliance o…

Automated Essay ScoringFeature EngineeringSentence

Automated Arabic Essay Evaluation

2020-12-01 · ICON 2020 12 · Abeer Alqahtani, Amal Alsaif

Although the manual evaluation of essays is a time-consuming process, writing essays has a significant role in assessing learning outcomes. Therefore, automated essay evaluation represents a solution, especially for scho…

Automatic Essay Multi-dimensional Scoring with Fine-tuning and Multiple Regression

2024-06-03 · Kun Sun, Rong Wang

Automated essay scoring (AES) involves predicting a score that reflects the writing quality of an essay. Most existing AES systems produce only a single overall score. However, users and L2 learners expect scores across …

Automated Essay Scoringregression