Benchmarking LLMs for Mimicking Child-Caregiver Language in Interaction
LLMs can generate human-like dialogues, yet their ability to simulate early child-adult interactions remains largely unexplored. In this paper, we examined how effectively LLMs can capture the distinctive features of child-caregiver language in interaction, using both static and interactive benchmarking methods. We found that state-of-the-art LLMs like Llama 3 and GPT-4o can approximate child-caregiver dialogues at the word and utterance level, but they struggle to reproduce the child and caregiver's discursive patterns, exaggerate alignment, and fail to reach the level of diversity shown by humans. The broader goal of this work is to initiate the development of a comprehensive benchmark for LLMs in child-oriented applications.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingDiversityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Combining Large Language Models with Tutoring System Intelligence: A Case Study in Caregiver Homework Support
Caregivers (i.e., parents and members of a child's caring community) are underappreciated stakeholders in learning analytics. Although caregiver involvement can enhance student academic outcomes, many obstacles hinder in…
Large Language ModelMathPrompt EngineeringGenQ: Automated Question Generation to Support Caregivers While Reading Stories with Children
When caregivers ask open--ended questions to motivate dialogue with children, it facilitates the child's reading comprehension skills.Although there is scope for use of technological tools, referred here as "intelligent …
Question GenerationQuestion-GenerationReading ComprehensionChild-directed Listening: How Caregiver Inference Enables Children's Early Verbal Communication
How do adults understand children's speech? Children's productions over the course of language development often bear little resemblance to typical adult pronunciations, yet caregivers nonetheless reliably recover meanin…
Language AcquisitionAutomatic Annotation of Grammaticality in Child-Caregiver Conversations
The acquisition of grammar has been a central question to adjudicate between theories of language acquisition. In order to conduct faster, more reproducible, and larger-scale corpus studies on grammaticality in child-car…
Language AcquisitionGaze Behavior During a Long-Term, In-Home, Social Robot Intervention for Children with ASD
Atypical gaze behavior is a diagnostic hallmark of Autism Spectrum Disorder (ASD), playing a substantial role in the social and communicative challenges that individuals with ASD face. This study explores the impacts of …
Diagnostic