paper-with-me

Papers

The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmers

2024-05-28 · James Prather, Brent Reeves, Juho Leinonen, Stephen MacNeil, Arisoa S. Randrianasolo, Brett Becker, Bailey Kimmel, Jared Wright, Ben Briggs

Novice programmers often struggle through programming problem solving due to a lack of metacognitive awareness and strategies. Previous research has shown that novices can encounter multiple metacognitive difficulties while programming. Novices are typically unaware of how these difficulties are hindering their progress. Meanwhile, many novices are now programming with generative AI (GenAI), which can provide complete solutions to most introductory programming problems, code suggestions, hints for next steps when stuck, and explain cryptic error messages. Its impact on novice metacognition has only started to be explored. Here we replicate a previous study that examined novice programming problem solving behavior and extend it by incorporating GenAI tools. Through 21 lab sessions consisting of participant observation, interview, and eye tracking, we explore how novices are coding with GenAI tools. Although 20 of 21 students completed the assigned programming problem, our findings show an unfortunate divide in the use of GenAI tools between students who accelerated and students who struggled. Students who accelerated were able to use GenAI to create code they already intended to make and were able to ignore unhelpful or incorrect inline code suggestions. But for students who struggled, our findings indicate that previously known metacognitive difficulties persist, and that GenAI unfortunately can compound them and even introduce new metacognitive difficulties. Furthermore, struggling students often expressed cognitive dissonance about their problem solving ability, thought they performed better than they did, and finished with an illusion of competence. Based on our observations from both groups, we propose ways to scaffold the novice GenAI experience and make suggestions for future work.

📄 PDF Abstract BibTeX arXiv:2405.17739

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Robo-Blocks: Generative Scaffolding in End-User Design and Programming of Social Robots

2026-05-27 · Arissa J. Sato, Callie Y. Kim, Nathan Thomas White, Abhinav Maneesh 외 arxiv

Programming social robots is challenging for novice robot programmers due to required expertise in planning, interaction design, and programming. While large language models (LLMs) hold significant promise through code g…

Code Generation

Rule-Based Error Classification for Analyzing Differences in Frequent Errors

2023-11-01 · Atsushi Shirafuji, Taku Matsumoto, Md Faizul Ibne Amin, Yutaka Watanobe

Finding and fixing errors is a time-consuming task not only for novice programmers but also for expert programmers. Prior work has identified frequent error patterns among various levels of programmers. However, the diff…

Evaluating the Quality of Code Comments Generated by Large Language Models for Novice Programmers

2024-09-22 · Aysa Xuemo Fan, Arun Balajiee Lekshmi Narayanan, Mohammad Hassany, Jiaze Ke

Large Language Models (LLMs) show promise in generating code comments for novice programmers, but their educational effectiveness remains under-evaluated. This study assesses the instructional quality of code comments pr…

Natural Language Processing 4 All (NLP4All): A New Online Platform for Teaching and Learning NLP Concepts

2021-05-28 · NAACL (TeachingNLP) 2021 6 · Rebekah Baglini, Arthur Hjorth

Natural Language Processing offers new insights into language data across almost all disciplines and domains, and allows us to corroborate and/or challenge existing knowledge. The primary hurdles to widening participatio…

All

GenAI Voice Mode in Programming Education

2025-09-12 · Sven Jacobs, Natalie Kiesler arxiv

Real-time voice interfaces using multimodal Generative AI (GenAI) can potentially address the accessibility needs of novice programmers with disabilities (e.g., related to vision). Yet, little is known about how novices …