paper-with-me

홈 › Papers

The StudyChat Dataset: Student Dialogues With ChatGPT in an Artificial Intelligence Course

2025-03-11 · Hunter McNichols, Andrew Lan

The widespread availability of large language models (LLMs), such as ChatGPT, has significantly impacted education, raising both opportunities and challenges. Students can frequently interact with LLM-powered, interactive learning tools, but their usage patterns need to be analyzed to ensure ethical usage of these tools. To better understand how students interact with LLMs in an academic setting, we introduce \textbf{StudyChat}, a publicly available dataset capturing real-world student interactions with an LLM-powered tutoring chatbot in a semester-long, university-level artificial intelligence (AI) course. We deploy a web application that replicates ChatGPT's core functionalities, and use it to log student interactions with the LLM while working on programming assignments. We collect 1,197 conversations, which we annotate using a dialogue act labeling schema inspired by observed interaction patterns and prior research. Additionally, we analyze these interactions, highlight behavioral trends, and analyze how specific usage patterns relate to course outcomes. \textbf{StudyChat} provides a rich resource for the learning sciences and AI in education communities, enabling further research into the evolving role of LLMs in education.

📄 PDF Abstract BibTeX arXiv:2503.07928

Code (0)

등록된 구현이 없습니다.

Tasks

Chatbot

Similar Papers 제목 키워드 기반

RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Education

2024-03-13 · Jieun Han, Haneul Yoo, Junho Myung, Minsun Kim 외

The integration of generative AI in education is expanding, yet empirical analyses of large-scale and real-world interactions between students and AI systems still remain limited. Addressing this gap, we present RECIPE4U…

Intent DetectionTask-Oriented Dialogue Systems

Sparks of Artificial General Recommender (AGR): Early Experiments with ChatGPT

2023-05-08 · Guo Lin, Yongfeng Zhang

This study investigates the feasibility of developing an Artificial General Recommender (AGR), facilitated by recent advancements in Large Language Models (LLMs). An AGR comprises both conversationality and universality …

ChEDDAR: Student-ChatGPT Dialogue in EFL Writing Education

2023-09-23 · Jieun Han, Haneul Yoo, Junho Myung, Minsun Kim 외

The integration of generative AI in education is expanding, yet empirical analyses of large-scale, real-world interactions between students and AI systems still remain limited. In this study, we present ChEDDAR, ChatGPT …

Intent DetectionTask-Oriented Dialogue Systems

Exploring LLMs for Predicting Tutor Strategy and Student Outcomes in Dialogues

2025-07-09 · Fareya Ikram, Alexander Scarlatos, Andrew Lan arxiv

Tutoring dialogues have gained significant attention in recent years, given the prominence of online learning and the emerging tutoring abilities of artificial intelligence (AI) agents powered by large language models (L…

"ChatGPT, a Friend or Foe for Education?" Analyzing the User's Perspectives on the Latest AI Chatbot Via Reddit

2023-09-27 · Forhan Bin Emdad, Benhur Ravuri, Lateef Ayinde, Mohammad Ishtiaque Rahman

Latest developments in Artificial Intelligence (AI) and big data gave rise to Artificial Intelligent agents like Open AI's ChatGPT, which has recently become the fastest growing application since Facebook and WhatsApp. C…

ChatbotDescriptiveSentiment Analysis