paper-with-me

홈 › Papers

To what extent is ChatGPT useful for language teacher lesson plan creation?

2024-04-25 · Alex Dornburg, Kristin Davin

The advent of generative AI models holds tremendous potential for aiding teachers in the generation of pedagogical materials. However, numerous knowledge gaps concerning the behavior of these models obfuscate the generation of research-informed guidance for their effective usage. Here we assess trends in prompt specificity, variability, and weaknesses in foreign language teacher lesson plans generated by zero-shot prompting in ChatGPT. Iterating a series of prompts that increased in complexity, we found that output lesson plans were generally high quality, though additional context and specificity to a prompt did not guarantee a concomitant increase in quality. Additionally, we observed extreme cases of variability in outputs generated by the same prompt. In many cases, this variability reflected a conflict between 20th century versus 21st century pedagogical practices. These results suggest that the training of generative AI models on classic texts concerning pedagogical practices may represent a currently underexplored topic with the potential to bias generated content towards teaching practices that have been long refuted by research. Collectively, our results offer immediate translational implications for practicing and training foreign language teachers on the use of AI tools. More broadly, these findings reveal the existence of generative AI output trends that have implications for the generation of pedagogical materials across a diversity of content areas.

📄 PDF Abstract BibTeX arXiv:2407.09974

Code (0)

등록된 구현이 없습니다.

Tasks

Specificity

Similar Papers 제목 키워드 기반

How Prevalent is Gender Bias in ChatGPT? -- Exploring German and English ChatGPT Responses

2023-09-21 · Stefanie Urchs, Veronika Thurner, Matthias Aßenmacher, Christian Heumann 외

With the introduction of ChatGPT, OpenAI made large language models (LLM) accessible to users with limited IT expertise. However, users with no background in natural language processing (NLP) might lack a proper understa…

Does ChatGPT have Theory of Mind?

2023-05-23 · Bart Holterman, Kees Van Deemter

Theory of Mind (ToM) is the ability to understand human thinking and decision-making, an ability that plays a crucial role in social interaction between people, including linguistic communication. This paper investigates…

Decision Making

Seeing ChatGPT Through Students' Eyes: An Analysis of TikTok Data

2023-03-09 · Anna-Carolina Haensch, Sarah Ball, Markus Herklotz, Frauke Kreuter

Advanced large language models like ChatGPT have gained considerable attention recently, including among students. However, while the debate on ChatGPT in academia is making waves, more understanding is needed among lect…

Exploring the Use of ChatGPT for a Systematic Literature Review: a Design-Based Research

2024-09-25 · Qian Huang, Qiyun Wang

ChatGPT has been used in several educational contexts,including learning, teaching and research. It also has potential to conduct the systematic literature review (SLR). However, there are limited empirical studies on ho…

Systematic Literature Review

How will Language Modelers like ChatGPT Affect Occupations and Industries?

2023-03-02 · Ed Felten, Manav Raj, Robert Seamans

Recent dramatic increases in AI language modeling capabilities has led to many questions about the effect of these technologies on the economy. In this paper we present a methodology to systematically assess the extent t…

Language ModelingLanguage Modelling