paper-with-me

홈 › Papers

Predicting ChatGPT Use in Assignments: Implications for AI-Aware Assessment Design

2025-08-16 · Surajit Das, Aleksei Eliseev arxiv

The rise of generative AI tools like ChatGPT has significantly reshaped education, sparking debates about their impact on learning outcomes and academic integrity. While prior research highlights opportunities and risks, there remains a lack of quantitative analysis of student behavior when completing assignments. Understanding how these tools influence real-world academic practices, particularly assignment preparation, is a pressing and timely research priority. This study addresses this gap by analyzing survey responses from 388 university students, primarily from Russia, including a subset of international participants. Using the XGBoost algorithm, we modeled predictors of ChatGPT usage in academic assignments. Key predictive factors included learning habits, subject preferences, and student attitudes toward AI. Our binary classifier demonstrated strong predictive performance, achieving 80.1\% test accuracy, with 80.2\% sensitivity and 79.9\% specificity. The multiclass classifier achieved 64.5\% test accuracy, 64.6\% weighted precision, and 64.5\% recall, with similar training scores, indicating potential data scarcity challenges. The study reveals that frequent use of ChatGPT for learning new concepts correlates with potential overreliance, raising concerns about long-term academic independence. These findings suggest that while generative AI can enhance access to knowledge, unchecked reliance may erode critical thinking and originality. We propose discipline-specific guidelines and reimagined assessment strategies to balance innovation with academic rigor. These insights can guide educators and policymakers in ethically and effectively integrating AI into education.

📄 PDF Abstract BibTeX arXiv:2508.12013

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Student Mastery or AI Deception? Analyzing ChatGPT's Assessment Proficiency and Evaluating Detection Strategies

2023-11-27 · Kevin Wang, Seth Akins, Abdallah Mohammed, Ramon Lawrence

Generative AI systems such as ChatGPT have a disruptive effect on learning and assessment. Computer science requires practice to develop skills in problem solving and programming that are traditionally developed using as…

Large Language Models in Introductory Programming Education: ChatGPT's Performance and Implications for Assessments

2023-08-15 · Natalie Kiesler, Daniel Schiffner

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment fo…

HowkGPT: Investigating the Detection of ChatGPT-generated University Student Homework through Context-Aware Perplexity Analysis

2023-05-26 · Christoforos Vasilatos, Manaar Alam, Talal Rahwan, Yasir Zaki 외

As the use of Large Language Models (LLMs) in text generation tasks proliferates, concerns arise over their potential to compromise academic integrity. The education sector currently tussles with distinguishing student-a…

SpecificityText Generation

Can ChatGPT Read Who You Are?

2023-12-26 · Erik Derner, Dalibor Kučera, Nuria Oliver, Jan Zahálka

The interplay between artificial intelligence (AI) and psychology, particularly in personality assessment, represents an important emerging area of research. Accurate personality trait estimation is crucial not only for …

Chatbot

Generative AI: Implications and Applications for Education

2023-05-12 · Anastasia Olga, Tzirides, Akash Saini, Gabriela Zapata 외

The launch of ChatGPT in November 2022 precipitated a panic among some educators while prompting qualified enthusiasm from others. Under the umbrella term Generative AI, ChatGPT is an example of a range of technologies f…