paper-with-me

홈 › Papers

Exploring the Value of Diverse LLM Explanations in Introductory Programming

2026-06-27 · Seth Bernstein, Paul Denny, Juho Leinonen, Kush Patel, Rayhona Nasimova, Matt Littlefield, Stephen MacNeil arxiv

Large Language Models (LLMs) have shown the potential to generate code explanations that surpass those of peers in quality, offering promising opportunities for computer science education. While these explanations may not yet match the depth and clarity of instructor-provided explanations, research in computational creativity highlights that the quantity and diversity of ideas can often outweigh a singular focus on quality. Inspired by this, we explore whether combining multiple diverse explanations, each emphasizing distinct aspects (e.g., function, concept, goal), can enhance students' understanding of programming exercises compared to generic explanations that do not emphasize distinct conceptual aspects. In our study 971 first-year computing students were randomly assigned either diverse or generic LLM-generated explanations for two programming exercises. Students completed multiple-choice and open-ended questions for each exercise, followed by Likert-scale questions and open-ended reflections. Our findings outline patterns in student performance and perceived cognitive load across the two explanation conditions. These findings highlight how variation in explanation emphasis may relate to learner engagement and understanding. Across participants, open-ended response accuracy was consistently about 7.7% higher when students received diverse explanations, with no difference in perceived cognitive load.

📄 PDF Abstract BibTeX arXiv:2606.28882

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Large Language Models in Introductory Programming Education: ChatGPT's Performance and Implications for Assessments

2023-08-15 · Natalie Kiesler, Daniel Schiffner

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment fo…

Exploring the Potential of Large Language Models in Generating Code-Tracing Questions for Introductory Programming Courses

2023-10-23 · Aysa Xuemo Fan, Ranran Haoran Zhang, Luc Paquette, Rui Zhang

In this paper, we explore the application of large language models (LLMs) for generating code-tracing questions in introductory programming courses. We designed targeted prompts for GPT4, guiding it to generate code-trac…

Exploring the Potential of Large Language Models to Generate Formative Programming Feedback

2023-08-31 · Natalie Kiesler, Dominic Lohr, Hieke Keuning

Ever since the emergence of large language models (LLMs) and related applications, such as ChatGPT, its performance and error analysis for programming tasks have been subject to research. In this work-in-progress paper, …

Automatic Generation of Programming Exercises and Code Explanations using Large Language Models

2022-06-03 · Sami Sarsa, Paul Denny, Arto Hellas, Juho Leinonen

This article explores the natural language generation capabilities of large language models with application to the production of two types of learning resources common in programming courses. Using OpenAI Codex as the l…

Language ModelingLanguage ModellingLarge Language ModelText Generation

Measuring Item Similarity in Introductory Programming: Python and Robot Programming Case Studies

2018-05-24 · Radek Pelánek, Tomáš Effenberger, Matěj Vaněk, Vojtěch Sassmann 외

A personalized learning system needs a large pool of items for learners to solve. When working with a large pool of items, it is useful to measure the similarity of items. We outline a general approach to measuring the s…