paper-with-me

Papers

Synthesizing Tasks for Block-based Programming

2020-06-17 · NeurIPS 2020 12 · Umair Z. Ahmed, Maria Christakis, Aleksandr Efremov, Nigel Fernandez, Ahana Ghosh, Abhik Roychoudhury, Adish Singla

Block-based visual programming environments play a critical role in introducing computing concepts to K-12 students. One of the key pedagogical challenges in these environments is in designing new practice tasks for a student that match a desired level of difficulty and exercise specific programming concepts. In this paper, we formalize the problem of synthesizing visual programming tasks. In particular, given a reference visual task $\rm T^{in}$ and its solution code $\rm C^{in}$, we propose a novel methodology to automatically generate a set $\{(\rm T^{out}, \rm C^{out})\}$ of new tasks along with solution codes such that tasks $\rm T^{in}$ and $\rm T^{out}$ are conceptually similar but visually dissimilar. Our methodology is based on the realization that the mapping from the space of visual tasks to their solution codes is highly discontinuous; hence, directly mutating reference task $\rm T^{in}$ to generate new tasks is futile. Our task synthesis algorithm operates by first mutating code $\rm C^{in}$ to obtain a set of codes $\{\rm C^{out}\}$. Then, the algorithm performs symbolic execution over a code $\rm C^{out}$ to obtain a visual task $\rm T^{out}$; this step uses the Monte Carlo Tree Search (MCTS) procedure to guide the search in the symbolic tree. We demonstrate the effectiveness of our algorithm through an extensive empirical evaluation and user study on reference tasks taken from the \emph{Hour of Code: Classic Maze} challenge by \emph{Code.org} and the \emph{Intro to Programming with Karel} course by \emph{CodeHS.com}.

📄 PDF Abstract BibTeX arXiv:2006.16913

Code (1)

adishs/neurips2020_synthesizing-tasks_code 공식 구현

Similar Papers 제목 키워드 기반

Synthesizing a Progression of Subtasks for Block-Based Visual Programming Tasks

2023-05-27 · Alperen Tercan, Ahana Ghosh, Hasan Ferit Eniser, Maria Christakis 외

Block-based visual programming environments play an increasingly important role in introducing computing concepts to K-12 students. In recent years, they have also gained popularity in neuro-symbolic AI, serving as a ben…

Logical Reasoning

From {Solution Synthesis} to {Student Attempt Synthesis} for Block-Based Visual Programming Tasks

2022-05-03 · Adish Singla, Nikitas Theodoropoulos

Block-based visual programming environments are increasingly used to introduce computing concepts to beginners. Given that programming tasks are open-ended and conceptual, novice students often struggle when learning in …

MisconceptionsProgram Synthesis

Adaptive Scaffolding in Block-Based Programming via Synthesizing New Tasks as Pop Quizzes

2023-03-28 · Ahana Ghosh, Sebastian Tschiatschek, Sam Devlin, Adish Singla

Block-based programming environments are increasingly used to introduce computing concepts to beginners. However, novice students often struggle in these environments, given the conceptual and open-ended nature of progra…

Neural Task Synthesis for Visual Programming

2023-05-26 · Victor-Alexandru Pădurean, Georgios Tzannetos, Adish Singla

Generative neural models hold great promise in enhancing programming education by synthesizing new content. We seek to design neural models that can automatically generate programming tasks for a given specification in t…

Imitation LearningSpatial Reasoning

M2G-Eval: Enhancing and Evaluating Multi-granularity Multilingual Code Generation

2025-12-27 · Fanglin Xu, Wei Zhang, Jian Yang, Guo Chen 외 arxiv

The rapid advancement of code large language models (LLMs) has sparked significant research interest in systematically evaluating their code generation capabilities, yet existing benchmarks predominantly assess models at…

Code Generation