TeachBench: A Syllabus-Grounded Framework for Evaluating Teaching Ability in Large Language Models
Large language models (LLMs) show promise as teaching assistants, yet their teaching capability remains insufficiently evaluated. Existing benchmarks mainly focus on problem-solving or problem-level guidance, leaving knowledge-centered teaching underexplored. We propose a syllabus-grounded evaluation framework that measures LLM teaching capability via student performance improvement after multi-turn instruction. By restricting teacher agents to structured knowledge points and example problems, the framework avoids information leakage and enables reuse of existing benchmarks. We instantiate the framework on Gaokao data across multiple subjects. Experiments reveal substantial variation in teaching effectiveness across models and domains: some models perform well in mathematics, while teaching remains challenging in physics and chemistry. We also find that incorporating example problems does not necessarily improve teaching, as models often shift toward example-specific error correction. Overall, our results highlight teaching ability as a distinct and measurable dimension of LLM behavior.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Using the Interactive Graphic Syllabus in the Teaching of Economics
Syllabus is essentially a concise outline of a course of study, and conventionally a text document. In the past few decades, however, two novel variations of syllabus have emerged, namely "the Graphic Syllabus" and "the …
ManagementDesigning Singing Syllabi with Virtual Avatars: AI-Assisted Syllabus Reauthoring
Traditional syllabi often function as static reference documents rather than engaging introductions to a course. In practical teaching, we observe that few students thoroughly read or fully comprehend the information pro…
Music GenerationAgent Smith: Teaching Question Answering to Jill Watson
Building AI agents can be costly. Consider a question answering agent such as Jill Watson that automatically answers students' questions on the discussion forums of online classes based on their syllabi and other course …
AI AgentQuestion AnsweringSyllabusQA: A Course Logistics Question Answering Dataset
Automated teaching assistants and chatbots have significant potential to reduce the workload of human instructors, especially for logistics-related question answering, which is important to students yet repetitive for in…
Language ModelingLanguage ModellingLarge Language ModelQuestion Answering+2An Empirical Comparison of Syllabuses for Curriculum Learning
Syllabuses for curriculum learning have been developed on an ad-hoc, per task basis and little is known about the relative performance of different syllabuses. We identify a number of syllabuses used in the literature. W…