An Exploratory Study into Automated Pr\'ecis Grading
Automated writing evaluation is a popular research field, but the main focus has been on evaluating argumentative essays. In this paper, we consider a different genre, namely pr{\'e}cis texts. A pr{\'e}cis is a written text that provides a coherent summary of main points of a spoken or written text. We present a corpus of English pr{\'e}cis texts which all received a grade assigned by a highly-experienced English language teacher and were subsequently annotated following an exhaustive error typology. With this corpus we trained a machine learning model which relies on a number of linguistic, automatic summarization and AWE features. Our results reveal that this model is able to predict the grade of pr{\'e}cis texts with only a moderate error margin.
Code (0)
등록된 구현이 없습니다.
Tasks
Automated Writing EvaluationSimilar Papers 제목 키워드 기반
EssayCBM: Rubric-Aligned Concept Bottleneck Models for Transparent Essay Grading
Automated essay scoring (AES) has advanced significantly with neural language models, yet most systems remain opaque, offering little visibility into how grades are produced. In educational settings, instructors must be …
Automated Essay ScoringARAGOG: Advanced RAG Output Grading
Retrieval-Augmented Generation (RAG) is essential for integrating external knowledge into Large Language Model (LLM) outputs. While the literature on RAG is growing, it primarily focuses on systematic reviews and compari…
Document EmbeddingLanguage ModelingLanguage ModellingLarge Language Model+5Improving Acne Image Grading with Label Distribution Smoothing
Acne, a prevalent skin condition, necessitates precise severity assessment for effective treatment. Acne severity grading typically involves lesion counting and global assessment. However, manual grading suffers from var…
Acne Severity GradingOrange Quality Grading with Deep Learning
Orange grading is a crucial step in the fruit industry, as it helps to sort oranges according to different criteria such as size, quality, ripeness, and health condition, ensuring safety for human consumption and better …
Deep LearningAutomated Long Answer Grading with RiceChem Dataset
We introduce a new area of study in the field of educational Natural Language Processing: Automated Long Answer Grading (ALAG). Distinguishing itself from Automated Short Answer Grading (ASAG) and Automated Essay Grading…
College ChemistryNatural Language InferenceTransfer Learning