Small Language Models for Curriculum-based Guidance

2025-09-27 · Konstantinos Katharakis, Sippo Rossi, Raghava Rao Mukkamala arxiv

The adoption of generative AI and large language models (LLMs) in education is still emerging. In this study, we explore the development and evaluation of AI teaching assistants that provide curriculum-based guidance using a retrieval-augmented generation (RAG) pipeline applied to selected open-source small language models (SLMs). We benchmarked eight SLMs, including LLaMA 3.1, IBM Granite 3.3, and Gemma 3 (7-17B parameters), against GPT-4o. Our findings show that with proper prompting and targeted retrieval, SLMs can match LLMs in delivering accurate, pedagogically aligned responses. Importantly, SLMs offer significant sustainability benefits due to their lower computational and energy requirements, enabling real-time use on consumer-grade hardware without depending on cloud infrastructure. This makes them not only cost-effective and privacy-preserving but also environmentally responsible, positioning them as viable AI teaching assistants for educational institutions aiming to scale personalized learning in a sustainable and energy-efficient manner.

📄 PDF Abstract BibTeX arXiv:2510.02347

Code (0)

등록된 구현이 없습니다.

Curriculum Learning for Small Code Language Models

2024-07-14 · Marwa Naïr, Kamel Yamani, Lynda Said Lhadj, Riyadh Baghdadi

Code language models have emerged as useful tools for various programming tasks, yet they often struggle when it comes to complex ones. In this paper, we explore the potential of curriculum learning in enhancing the perf…

Code Completion Decoder

On-Policy Distillation with Curriculum Turn-level Guidance for Multi-turn Agents

2026-06-14 · Gengsheng Li, Mao Zheng, Mingyang Song, Ruiqi Liu 외 arxiv

Multi-turn agents that plan, invoke tools, and interact with environments offer a promising paradigm for solving complex tasks, yet their capabilities typically rely on very large models whose inference cost is prohibiti…

Less is More: Pre-Training Cross-Lingual Small-Scale Language Models with Cognitively-Plausible Curriculum Learning Strategies

2024-10-30 · Suchir Salhan, Richard Diehl Martinez, Zébulon Goriely, Paula Buttery

Curriculum Learning has been a popular strategy to improve the cognitive plausibility of Small-Scale Language Models (SSLMs) in the BabyLM Challenge. However, it has not led to considerable improvements over non-curricul…

Language Acquisition Masked Language Modeling

Outcome-directed Reinforcement Learning by Uncertainty & Temporal Distance-Aware Curriculum Goal Generation

2023-01-27 · Daesol Cho, Seungjae Lee, H. Jin Kim

Current reinforcement learning (RL) often suffers when solving a challenging exploration problem where the desired outcomes or high rewards are rarely observed. Even though curriculum RL, a framework that solves complex …

reinforcement-learning Reinforcement Learning (RL)

IRIS: Interleaved Reinforcement with Incremental Staged Curriculum for Cross-Lingual Mathematical Reasoning

2026-04-27 · Navya Gupta, Rishitej Reddy Vyalla, Avinash Anand, Chhavi Kirtani 외 arxiv

Curriculum learning helps language models tackle complex reasoning by gradually increasing task difficulty. However, it often fails to generate consistent step-by-step reasoning, especially in multilingual and low-resour…

Reinforcement Learning Cross-Lingual Transfer Mathematical Reasoning