paper-with-me

Papers

Teaching Through Analogies: A Modular Pipeline for Educational Analogy Generation

2026-05-22 · Mariam Barakat, Ekaterina Kochmar arxiv

Analogies help learners understand unfamiliar concepts by relating them to known concepts. Despite recent advances, large language models (LLMs) continue to struggle to generate analogies of comparable quality to those produced by humans. We present a modular pipeline for educational analogy generation, decomposing the task into four stages: source finding, sub-concept generation, explanation generation, and evaluation. Grounded in Structure Mapping Theory, the pipeline enables systematic, stage-by-stage analysis of how model choice and input configuration affect analogy quality. We evaluate 12 state-of-the-art LLMs across six model families on two datasets with structured sub-concept annotations (SCAR and ParallelPARC), alongside seven embedding models for closed-setting retrieval. Our results show that sub-concepts substantially improve explanation quality and closed setting retrieval precision but provide limited benefit in open-ended source generation. We further introduce an LLM-as-a-judge evaluation methodology and validate its scoring against human annotations from seven annotators, finding that Claude Sonnet 4.6 aligns more reliably with human rankings than with fine-grained absolute scores. Taken together, our findings reveal cross-stage interactions that isolated studies cannot capture, and highlight sub-concept grounding as a key driver of analogy quality generation.

📄 PDF Abstract BibTeX arXiv:2605.24211

Code (0)

등록된 구현이 없습니다.

Tasks

Explanation Generation

Similar Papers 제목 키워드 기반

Why teaching resists automation in an AI-inundated era: Human judgment, non-modular work, and the limits of delegation

2026-04-08 · Songhee Han arxiv

Debates about artificial intelligence (AI) in education often portray teaching as a modular and procedural job that can increasingly be automated or delegated to technology. This brief communication paper argues that suc…

TeachingCoach: A Fine-Tuned Scaffolding Chatbot for Instructional Guidance to Instructors

2026-03-18 · Isabel Molnar, Peiyu Li, Si Chen, Sugana Chawla 외 arxiv

Higher education instructors often lack timely and pedagogically grounded support, as scalable instructional guidance remains limited and existing tools rely on generic chatbot advice or non-scalable teaching center huma…

Dialogue Generation

EducationQ: Evaluating LLMs' Teaching Capabilities Through Multi-Agent Dialogue Framework

2025-04-21 · Yao Shi, Rongkeng Liang, Yong Xu

Large language models (LLMs) increasingly serve as educational tools, yet evaluating their teaching capabilities remains challenging due to the resource-intensive, context-dependent, and methodologically complex nature o…

Can AI be a Teaching Partner? Evaluating ChatGPT, Gemini, and DeepSeek across Three Teaching Strategies

2026-02-24 · Talita de Paula Cypriano de Souza, Shruti Mehta, Matheus Arataque Uema, Luciano Bernardes de Paula 외 arxiv

There are growing promises that Large Language Models (LLMs) can support students' learning by providing explanations, feedback, and guidance. However, despite their rapid adoption and widespread attention, there is stil…

EduMod-LLM: A Modular Approach for Designing Flexible and Transparent Educational Assistants

2025-11-21 · Meenakshi Mittal, Rishi Khare, Mihran Miroyan, Chancharik Mitra 외 arxiv

With the growing use of Large Language Model (LLM)-based Question-Answering (QA) systems in education, it is critical to evaluate their performance across individual pipeline components. In this work, we introduce {\mode…