Automatic Detection of Inauthentic Templated Responses in English Language Assessments
In high-stakes English Language Assessments, low-skill test takers may employ memorized materials called `templates'' on essay questions to `game'' or fool the automated scoring system. In this study, we introduce the automated detection of inauthentic, templated responses (AuDITR) task, describe a machine learning-based approach to this task and illustrate the importance of regularly updating these models in production.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Application of an Automatic Plagiarism Detection System in a Large-scale Assessment of English Speaking Proficiency
This study aims to build an automatic system for the detection of plagiarized spoken responses in the context of an assessment of English speaking proficiency for non-native speakers. Classification models were trained t…
Generative AI and Digital Ecosystem Resilience: A Proactive Lifecycle-Based Survey
The proliferation of adversarial synthetic content, accelerated by Generative AI (GenAI) is rendering traditional reactive detection methods ineffective. This survey synthesizes emerging research to demonstrate a paradig…
Anomaly DetectionUsing Adaptive Empathetic Responses for Teaching English
Existing English-teaching chatbots rarely incorporate empathy explicitly in their feedback, but empathetic feedback could help keep students engaged and reduce learner anxiety. Toward this end, we propose the task of neg…
ChatbotTopology Imbalance and Relation Inauthenticity Aware Hierarchical Graph Attention Networks for Fake News Detection
Fake news detection is a challenging problem due to its tremendous real-world political and social impacts. Recent fake news detection works focus on learning news features from News Propagation Graph (NPG). However, lit…
Fake News DetectionGraph AttentionRelationStandardizing the Measurement of Text Diversity: A Tool and a Comparative Analysis of Scores
The diversity across outputs generated by large language models shapes the perception of their quality and utility. Prompt leaks, templated answer structure, and canned responses across different interactions are readily…
Diversity