Cheating Automatic Short Answer Grading: On the Adversarial Usage of Adjectives and Adverbs

2022-01-20 · Anna Filighera, Sebastian Ochs, Tim Steuer, Thomas Tregel

Automatic grading models are valued for the time and effort saved during the instruction of large student bodies. Especially with the increasing digitization of education and interest in large-scale standardized testing, the popularity of automatic grading has risen to the point where commercial solutions are widely available and used. However, for short answer formats, automatic grading is challenging due to natural language ambiguity and versatility. While automatic short answer grading models are beginning to compare to human performance on some datasets, their robustness, especially to adversarially manipulated data, is questionable. Exploitable vulnerabilities in grading models can have far-reaching consequences ranging from cheating students receiving undeserved credit to undermining automatic grading altogether - even when most predictions are valid. In this paper, we devise a black-box adversarial attack tailored to the educational short answer grading scenario to investigate the grading models' robustness. In our attack, we insert adjectives and adverbs into natural places of incorrect student answers, fooling the model into predicting them as correct. We observed a loss of prediction accuracy between 10 and 22 percentage points using the state-of-the-art models BERT and T5. While our attack made answers appear less natural to humans in our experiments, it did not significantly increase the graders' suspicions of cheating. Based on our experiments, we provide recommendations for utilizing automatic grading systems more safely in practice.

📄 PDF Abstract BibTeX arXiv:2201.08318

Code (1)

sebochs/adversarial_insertions 공식 구현 pytorch

Tasks

Adversarial Attackautomatic short answer gradingvalid

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…

SentencePiece 설명 없음

Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Don't take ``nswvtnvakgxpm'' for an answer --The surprising vulnerability of automatic content scoring systems to adversarial input

2020-12-01 · COLING 2020 8 · Yuning Ding, Brian Riordan, Andrea Horbach, Aoife Cahill 외

Automatic content scoring systems are widely used on short answer tasks to save human effort. However, the use of these systems can invite cheating strategies, such as students writing irrelevant answers in the hopes of …

AR-ASAG An ARabic Dataset for Automatic Short Answer Grading Evaluation

2020-05-01 · LREC 2020 5 · Leila Ouahrani, Djamal Bennouar

Automatic short answer grading is a significant problem in E-assessment. Several models have been proposed to deal with it. Evaluation and comparison of such solutions need the availability of Datasets with manual exampl…

automatic short answer grading Specificity

Distributed Vector Representations for Unsupervised Automatic Short Answer Grading

2016-12-01 · WS 2016 12 · Oliver Adams, Shourya Roy, Raghuram Krishnapuram

We address the problem of automatic short answer grading, evaluating a collection of approaches inspired by recent advances in distributional text representations. In addition, we propose an unsupervised approach for det…

automatic short answer grading Reading Comprehension text similarity Word Embeddings

ASAG2024: A Combined Benchmark for Short Answer Grading

2024-09-27 · Gérôme Meyer, Philip Breuer, Jonathan Fürst

Open-ended questions test a more thorough understanding than closed-ended questions and are often a preferred assessment method. However, open-ended questions are tedious to grade and subject to personal bias. Therefore,…

GradingAttack: Exposing Security Vulnerabilities in LLM Based Educational Grading Agents

2026-02-01 · Xueyi Li, Zhuoneng Zhou, Zitao Liu, Yongdong Wu arxiv

Large language models (LLMs) are increasingly deployed as educational agents for automatic short answer grading (ASAG) in real-world educational environments, significantly boosting assessment efficiency and scalability.…

Adversarial Attack