paper-with-me

홈 › Papers

Automatic essay scoring: leveraging Jaccard coefficient and Cosine similaritywith n-gram variation in vector space model approach

2025-10-17 · Andharini Dwi Cahyani, Moh. Wildan Fathoni, Fika Hastarita Rachman, Ari Basuki, Salman Amin, Bain Khusnul Khotimah arxiv

Automated essay scoring (AES) is a vital area of research aiming to provide efficient and accurate assessment tools for evaluating written content. This study investigates the effectiveness of two popular similarity metrics, Jaccard coefficient, and Cosine similarity, within the context of vector space models(VSM)employing unigram, bigram, and trigram representations. The data used in this research was obtained from the formative essay of the citizenship education subject in a junior high school. Each essay undergoes preprocessing to extract features using n-gram models, followed by vectorization to transform text data into numerical representations. Then, similarity scores are computed between essays using both Jaccard coefficient and Cosine similarity. The performance of the system is evaluated by analyzing the root mean square error (RMSE), which measures the difference between the scores given by human graders and those generated by the system. The result shows that the Cosine similarity outperformed the Jaccard coefficient. In terms of n-gram, unigrams have lower RMSE compared to bigrams and trigrams.

📄 PDF Abstract BibTeX arXiv:2510.15311

Code (0)

등록된 구현이 없습니다.

Tasks

Automated Essay Scoring

Similar Papers 제목 키워드 기반

Many Hands Make Light Work: Using Essay Traits to Automatically Score Essays

2021-02-01 · NAACL 2022 7 · Rahul Kumar, Sandeep Mathias, Sriparna Saha, Pushpak Bhattacharyya

Most research in the area of automatic essay grading (AEG) is geared towards scoring the essay holistically while there has also been some work done on scoring individual essay traits. In this paper, we describe a way to…

Automated Essay ScoringMulti-Task Learning

Automatic Essay Scoring Incorporating Rating Schema via Reinforcement Learning

2018-10-01 · EMNLP 2018 10 · Yucheng Wang, Zhongyu Wei, Yaqian Zhou, Xuanjing Huang

Automatic essay scoring (AES) is the task of assigning grades to essays without human interference. Existing systems for AES are typically trained to predict the score of each single essay at a time without considering t…

Machine Translationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+2

Can Neural Networks Automatically Score Essay Traits?

2020-07-01 · WS 2020 7 · S Mathias, eep, Pushpak Bhattacharyya

Essay traits are attributes of an essay that can help explain how well written (or badly written) the essay is. Examples of traits include Content, Organization, Language, Sentence Fluency, Word Choice, etc. A lot of res…

BIG-bench Machine LearningSentence

Attention-based Recurrent Convolutional Neural Network for Automatic Essay Scoring

2017-08-01 · CONLL 2017 8 · Fei Dong, Yue Zhang, Jie Yang

Neural network models have recently been applied to the task of automatic essay scoring, giving promising results. Existing work used recurrent neural networks and convolutional neural networks to model input essays, giv…

Feature EngineeringMachine TranslationSentenceSentiment Analysis

Fine-grained essay scoring of a complex writing task for native speakers

2017-09-01 · WS 2017 9 · Andrea Horbach, Dirk Scholten-Akoun, Yuning Ding, Torsten Zesch

Automatic essay scoring is nowadays successfully used even in high-stakes tests, but this is mainly limited to holistic scoring of learner essays. We present a new dataset of essays written by highly proficient German na…