paper-with-me

홈 › Papers

ParaStudent: Generating and Evaluating Realistic Student Code by Teaching LLMs to Struggle

2025-07-16 · Mihran Miroyan, Rose Niousha, Joseph E. Gonzalez, Gireeja Ranade, Narges Norouzi arxiv

Large Language Models (LLMs) have shown strong performance on programming tasks, but can they generate student-like code like real students - imperfect, iterative, and stylistically diverse? We present ParaStudent, a systematic study of LLM-based "student-like" code generation in an introductory programming course setting. Using a dataset of timestamped student submissions across multiple semesters, we design low- and high-resolution experiments to model student progress and evaluate code outputs along semantic, functional, and stylistic dimensions. Our results show that fine-tuning significantly improves alignment with real student trajectories and captures error patterns, incremental improvements, and stylistic variations more faithfully. This study shows that modeling realistic student code requires capturing learning dynamics through context-aware generation, temporal modeling, and multi-dimensional evaluation. Code for experiments and evaluation is available at https://github.com/mmiroyan/ParaStudent.

📄 PDF Abstract BibTeX arXiv:2507.12674

Code (0)

등록된 구현이 없습니다.

Tasks

Code Generation

Similar Papers 제목 키워드 기반

Evaluating Code Generation of LLMs in Advanced Computer Science Problems

2025-04-21 · Emir Catir, Robin Claesson, Rodothea Myrsini Tsoupidi

Large Language Models (LLMs), such as GitHub Copilot and ChatGPT have become popular among programming students. Students use LLMs to assist them in programming courses, including generating source code. Previous work ha…

Code Generation

From Answers to Questions: EQGBench for Evaluating LLMs' Educational Question Generation

2025-08-05 · Chengliang Zhou, Mei Wang, Ting Zhang, Qiannan Zhu 외 arxiv

Large Language Models (LLMs) have demonstrated remarkable capabilities in mathematical problem-solving. However, the transition from providing answers to generating high-quality educational questions presents significant…

Question Generation

Synthetic Students: A Comparative Study of Bug Distribution Between Large Language Models and Computing Students

2024-10-11 · Stephen MacNeil, Magdalena Rogalska, Juho Leinonen, Paul Denny 외

Large language models (LLMs) present an exciting opportunity for generating synthetic classroom data. Such data could include code containing a typical distribution of errors, simulated student behaviour to address the c…

Synthesis of Annotated Colorectal Cancer Tissue Images from Gland Layout

2023-05-08 · Srijay Deshpande, Fayyaz Minhas, Nasir Rajpoot

Generating realistic tissue images with annotations is a challenging task that is important in many computational histopathology applications. Synthetically generated images and annotations are valuable for training and …

DecoderImage GenerationImage-to-Image Translation

Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents

2025-05-26 · Tao Wu, Jingyuan Chen, Wang Lin, Mengze Li 외

Large language models (LLMs) are revolutionizing education, with LLM-based agents playing a key role in simulating student behavior. A major challenge in student simulation is modeling the diverse learning patterns of st…