paper-with-me

Papers

Building Knowledge from Interactions: An LLM-Based Architecture for Adaptive Tutoring and Social Reasoning

2025-04-02 · Luca Garello, Giulia Belgiovine, Gabriele Russo, Francesco Rea, Alessandra Sciutti

Integrating robotics into everyday scenarios like tutoring or physical training requires robots capable of adaptive, socially engaging, and goal-oriented interactions. While Large Language Models show promise in human-like communication, their standalone use is hindered by memory constraints and contextual incoherence. This work presents a multimodal, cognitively inspired framework that enhances LLM-based autonomous decision-making in social and task-oriented Human-Robot Interaction. Specifically, we develop an LLM-based agent for a robot trainer, balancing social conversation with task guidance and goal-driven motivation. To further enhance autonomy and personalization, we introduce a memory system for selecting, storing and retrieving experiences, facilitating generalized reasoning based on knowledge built across different interactions. A preliminary HRI user study and offline experiments with a synthetic dataset validate our approach, demonstrating the system's ability to manage complex interactions, autonomously drive training tasks, and build and retrieve contextual memories, advancing socially intelligent robotics.

📄 PDF Abstract BibTeX arXiv:2504.01588

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Teaching According to Students' Aptitude: Personalized Mathematics Tutoring via Persona-, Memory-, and Forgetting-Aware LLMs

2025-11-19 · Yang Wu, Rujing Yao, Tong Zhang, Yufei Shi 외 arxiv

Large Language Models (LLMs) are increasingly integrated into intelligent tutoring systems to provide human-like and adaptive instruction. However, most existing approaches fail to capture how students' knowledge evolves…

Knowledge Tracing

CogGen: A Learner-Centered Generative AI Architecture for Intelligent Tutoring with Programming Video

2025-06-25 · Wengxi Li, Roy Pea, Nick Haber, Hari Subramonyam

We introduce CogGen, a learner-centered AI architecture that transforms programming videos into interactive, adaptive learning experiences by integrating student modeling with generative AI tutoring based on the Cognitiv…

Knowledge TracingVideo SegmentationVideo Semantic Segmentation

ConvoLearn: A Learning Sciences Grounded Dataset for Fine-Tuning Dialogic AI Tutors

2026-01-13 · Mayank Sharma, Roy Pea, Hari Subramonyam arxiv

Despite their growing adoption in education, LLMs remain misaligned with the core principle of effective tutoring: the dialogic construction of knowledge. We introduce ConvoLearn, a dataset of 2,134 semi-synthetic tutor-…

Adaptive Scaffolding for Cognitive Engagement in an Intelligent Tutoring System

2026-02-07 · Sutapa Dey Tithi, Nazia Alam, Tahreem Yasir, Yang Shi 외 arxiv

The ICAP framework defines four cognitive engagement levels: Passive, Active, Constructive, and Interactive, where increased cognitive engagement can yield improved learning. However, personalizing learning activities th…

Reinforcement LearningKnowledge Tracing

"You might think about slightly revising the title”: Identifying Hedges in Peer-tutoring Interactions

2022-05-01 · ACL 2022 5 · Yann Raphalen, Chloé Clavel, Justine Cassell

Hedges have an important role in the management of rapport. In peer-tutoring, they are notably used by tutors in dyads experiencing low rapport to tone down the impact of instructions and negative feedback.Pursuing the o…

Management