Beyond Access: Guided LLM Scaffolding for Independent Learning in Undergraduate Statistics
Large language models (LLMs) are increasingly entering students' learning practices, but their educational value may depend on whether they are used to support reasoning or to complete tasks without engaging in the underlying reasoning. This study examines guided LLM use in an undergraduate Probability and Statistics course, focusing on the distinction between assigned LLM access and the quality of students' actual interaction with the model. In a four-week quasi-experimental summer program, students were organized into three balanced conditions: no LLM access, unrestricted LLM access, and guided LLM access. The guided condition used the same LLM platform as the unrestricted condition, but students received explicit training and rules intended to promote reasoning-focused help-seeking, stepwise hints, verification, and ethical use. All quizzes and the delayed final exam were completed without LLM or external assistance, allowing us to separate AI-supported practice performance from independent learning. Results show that guided use was associated with a clearer learning-oriented interaction pattern than unrestricted access, especially in prioritizing reasoning over final answers and requesting stepwise support. In behavior-defined analyses, Guided-LLM students showed a promising pattern of stronger no-help quiz performance, while practice scores showed no consistent Guided-LLM advantage. Available time measures did not support a simple duration-based explanation, and self-assessment calibration suggested better alignment between perceived and demonstrated understanding in Guided-LLM. These findings suggest that access alone may not reliably distinguish independent performance; instead, the quality of interaction and reasoning-focused scaffolds warrant further study.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
LogicLearner: A Tool for the Guided Practice of Propositional Logic Proofs
The study of propositional logic -- fundamental to the theory of computing -- is a cornerstone of the undergraduate computer science curriculum. Learning to solve logical proofs requires repeated guided practice, but und…
Evaluating the AI-Lab Intervention: Impact on Student Perception and Use of Generative AI in Early Undergraduate Computer Science Courses
Generative AI (GenAI) is rapidly entering computer science education, yet its effects on student learning, skill development, and perceptions remain underexplored. Concerns about overreliance coexist with a gap in resear…
ntLink: a toolkit for de novo genome assembly scaffolding and mapping using long reads
With the increasing affordability and accessibility of genome sequencing data, de novo genome assembly is an important first step to a wide variety of downstream studies and analyses. Therefore, bioinformatics tools that…
Computational EfficiencyThinking Outside the [Chat]Box: Bridging Computer Science and Industrial Design for Cognitive-Inclusive Generative AI
Current Generative AI (GenAI) interfaces remain largely constrained to chatbox interaction, which can impose high cognitive demands on users and create substantial barriers for people with intellectual disabilities (ID),…
From Understanding to Creation: A Prerequisite-Free AI Literacy Course with Technical Depth Across Majors
Most AI literacy courses for non-technical undergraduates emphasize conceptual breadth over technical depth. This paper describes UNIV 182, a prerequisite-free course at George Mason University that teaches undergraduate…