Mathematics Teachers Interactions with a Multi-Agent System for Personalized Problem Generation
Large language models can increasingly adapt educational tasks to learners characteristics. In the present study, we examine a multi-agent teacher-in-the-loop system for personalizing middle school math problems. The teacher enters a base problem and desired topic, the LLM generates the problem, and then four AI agents evaluate the problem using criteria that each specializes in (mathematical accuracy, authenticity, readability, and realism). Eight middle school mathematics teachers created 212 problems in ASSISTments using the system and assigned these problems to their students. We find that both teachers and students wanted to modify the fine-grained personalized elements of the real-world context of the problems, signaling issues with authenticity and fit. Although the agents detected many issues with realism as the problems were being written, there were few realism issues noted by teachers and students in the final versions. Issues with readability and mathematical hallucinations were also somewhat rare. Implications for multi-agent systems for personalization that support teacher control are given.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
V-Math: An Agentic Approach to the Vietnamese National High School Graduation Mathematics Exams
This paper develops an autonomous agentic framework called V-Math that aims to assist Vietnamese high school students in preparing for the National High School Graduation Mathematics Exams (NHSGMEs). The salient framewor…
Question GenerationTowards Teachable Conversational Agents
The traditional process of building interactive machine learning systems can be viewed as a teacher-learner interaction scenario where the machine-learners are trained by one or more human-teachers. In this work, we expl…
BIG-bench Machine LearningVirtual Pre-Service Teacher Assessment and Feedback via Conversational Agents
Conversational agents and assistants have been used for decades to facilitate learning. There are many examples of conversational agents used for educational and training purposes in K-12, higher education, healthcare, t…
Reading ComprehensionUsing Transformers to Provide Teachers with Personalized Feedback on their Classroom Discourse: The TalkMoves Application
TalkMoves is an innovative application designed to support K-12 mathematics teachers to reflect on, and continuously improve their instructional practices. This application combines state-of-the-art natural language proc…
speech-recognitionSpeech RecognitionDesign and Evaluation for a Prototype of an Online Tool to Access Mathematics Notions in Sign Language
The Sign{'}Maths project aims at giving access to pedagogical resources in Sign Language (SL). It will provide Deaf students and teachers with mathematics vocabulary in SL, this in order to contribute to the standardisat…
Navigate