paper-with-me

홈 › Papers

TeachBench: A Syllabus-Grounded Framework for Evaluating Teaching Ability in Large Language Models

2026-01-29 · Zheng Li, Siyao Song, Jingyuan Ma, Rui Li, Ying Zeng, Minghao Li, Zhifang Sui arxiv

Large language models (LLMs) show promise as teaching assistants, yet their teaching capability remains insufficiently evaluated. Existing benchmarks mainly focus on problem-solving or problem-level guidance, leaving knowledge-centered teaching underexplored. We propose a syllabus-grounded evaluation framework that measures LLM teaching capability via student performance improvement after multi-turn instruction. By restricting teacher agents to structured knowledge points and example problems, the framework avoids information leakage and enables reuse of existing benchmarks. We instantiate the framework on Gaokao data across multiple subjects. Experiments reveal substantial variation in teaching effectiveness across models and domains: some models perform well in mathematics, while teaching remains challenging in physics and chemistry. We also find that incorporating example problems does not necessarily improve teaching, as models often shift toward example-specific error correction. Overall, our results highlight teaching ability as a distinct and measurable dimension of LLM behavior.

📄 PDF Abstract BibTeX arXiv:2601.21375

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Using the Interactive Graphic Syllabus in the Teaching of Economics

2022-09-06 · Seyyed Ali Zeytoon Nejad Moosavian

Syllabus is essentially a concise outline of a course of study, and conventionally a text document. In the past few decades, however, two novel variations of syllabus have emerged, namely "the Graphic Syllabus" and "the …

Management

Designing Singing Syllabi with Virtual Avatars: AI-Assisted Syllabus Reauthoring

2025-08-16 · Xinxing Wu arxiv

Traditional syllabi often function as static reference documents rather than engaging introductions to a course. In practical teaching, we observe that few students thoroughly read or fully comprehend the information pro…

Music Generation

Agent Smith: Teaching Question Answering to Jill Watson

2021-12-22 · Ashok Goel, Harshvardhan Sikka, Eric Gregori

Building AI agents can be costly. Consider a question answering agent such as Jill Watson that automatically answers students' questions on the discussion forums of online classes based on their syllabi and other course …

AI AgentQuestion Answering

SyllabusQA: A Course Logistics Question Answering Dataset

2024-03-03 · Nigel Fernandez, Alexander Scarlatos, Andrew Lan

Automated teaching assistants and chatbots have significant potential to reduce the workload of human instructors, especially for logistics-related question answering, which is important to students yet repetitive for in…

Language ModelingLanguage ModellingLarge Language ModelQuestion Answering+2

An Empirical Comparison of Syllabuses for Curriculum Learning

2018-09-27 · Mark Collier, Joeran Beel

Syllabuses for curriculum learning have been developed on an ad-hoc, per task basis and little is known about the relative performance of different syllabuses. We identify a number of syllabuses used in the literature. W…