paper-with-me

Papers

GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Education

2024-03-28 · Mike Perkins, Jasper Roe, Binh H. Vu, Darius Postma, Don Hickerson, James McGaughran, Huy Q. Khuat

This study investigates the efficacy of six major Generative AI (GenAI) text detectors when confronted with machine-generated content that has been modified using techniques designed to evade detection by these tools (n=805). The results demonstrate that the detectors' already low accuracy rates (39.5%) show major reductions in accuracy (17.4%) when faced with manipulated content, with some techniques proving more effective than others in evading detection. The accuracy limitations and the potential for false accusations demonstrate that these tools cannot currently be recommended for determining whether violations of academic integrity have occurred, underscoring the challenges educators face in maintaining inclusive and fair assessment practices. However, they may have a role in supporting student learning and maintaining academic integrity when used in a non-punitive manner. These results underscore the need for a combined approach to addressing the challenges posed by GenAI in academia to promote the responsible and equitable use of these emerging technologies. The study concludes that the current limitations of AI text detectors require a critical approach for any possible implementation in HE and highlight possible alternatives to AI assessment strategies.

📄 PDF Abstract BibTeX arXiv:2403.19148

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacy

2023-07-03 · Maanak Gupta, CharanKumar Akiri, Kshitiz Aryal, Eli Parker 외

Undoubtedly, the evolution of Generative AI (GenAI) models has been the highlight of digital transformation in the year 2022. As the different GenAI models like ChatGPT and Google Bard continue to foster their complexity…

Code GenerationMalware Detection

Understanding Student and Academic Staff Perceptions of AI Use in Assessment and Feedback

2024-06-22 · Jasper Roe, Mike Perkins, Daniel Ruelle

The rise of Artificial Intelligence (AI) and Generative Artificial Intelligence (GenAI) in higher education necessitates assessment reform. This study addresses a critical gap by exploring student and academic staff expe…

DescriptiveText Detection

Generative AI Usage and Exam Performance

2024-04-30 · Janik Ole Wecks, Johannes Voshaar, Benedikt Jost Plate, Jochen Zimmermann

This study evaluates the impact of students' usage of generative artificial intelligence (GenAI) tools such as ChatGPT on their exam performance. We analyse student essays using GenAI detection systems to identify GenAI …

Impacts and Risk of Generative AI Technology on Cyber Defense

2023-06-22 · Subash Neupane, Ivan A. Fernandez, Sudip Mittal, Shahram Rahimi

Generative Artificial Intelligence (GenAI) has emerged as a powerful technology capable of autonomously producing highly realistic content in various domains, such as text, images, audio, and videos. With its potential f…

Face SwappingMisinformation

LLMs Integration in Software Engineering Team Projects: Roles, Impact, and a Pedagogical Design Space for AI Tools in Computing Education

2024-10-30 · Ahmed Kharrufa, Sami Alghamdi, Abeer Aziz, Christopher Bull

This work takes a pedagogical lens to explore the implications of generative AI (GenAI) models and tools, such as ChatGPT and GitHub Copilot, in a semester-long 2nd-year undergraduate Software Engineering Team Project. Q…