paper-with-me

홈 › Papers

Automated Bias Assessment in AI-Generated Educational Content Using CEAT Framework

2025-05-19 · Jingyang Peng, Wenyuan Shen, Jiarui Rao, Jionghao Lin

Recent advances in Generative Artificial Intelligence (GenAI) have transformed educational content creation, particularly in developing tutor training materials. However, biases embedded in AI-generated content--such as gender, racial, or national stereotypes--raise significant ethical and educational concerns. Despite the growing use of GenAI, systematic methods for detecting and evaluating such biases in educational materials remain limited. This study proposes an automated bias assessment approach that integrates the Contextualized Embedding Association Test with a prompt-engineered word extraction method within a Retrieval-Augmented Generation framework. We applied this method to AI-generated texts used in tutor training lessons. Results show a high alignment between the automated and manually curated word sets, with a Pearson correlation coefficient of r = 0.993, indicating reliable and consistent bias assessment. Our method reduces human subjectivity and enhances fairness, scalability, and reproducibility in auditing GenAI-produced educational content.

📄 PDF Abstract BibTeX arXiv:2505.12718

Code (1)

EricP66/Automated-Word-Extraction 공식 구현

Tasks

FairnessRetrieval-augmented Generation

Similar Papers 제목 키워드 기반

Using Large Multimodal Models to Extract Knowledge Components for Knowledge Tracing from Multimedia Question Information

2024-09-30 · Hyeongdon Moon, Richard Davis, Seyed Parsa Neshaei, Pierre Dillenbourg

Knowledge tracing models have enabled a range of intelligent tutoring systems to provide feedback to students. However, existing methods for knowledge tracing in learning sciences are predominantly reliant on statistical…

Knowledge Tracing

The Rise of Artificial Intelligence in Educational Measurement: Opportunities and Ethical Challenges

2024-06-27 · Okan Bulut, Maggie Beiting-Parrish, Jodi M. Casabianca, Sharon C. Slater 외

The integration of artificial intelligence (AI) in educational measurement has revolutionized assessment methods, enabling automated scoring, rapid content analysis, and personalized feedback through machine learning and…

Decision MakingFairness

Lightweight Prompt Engineering for Cognitive Alignment in Educational AI: A OneClickQuiz Case Study

2025-10-03 · Antoun Yaacoub, Zainab Assaghir, Jérôme Da-Rugna arxiv

The rapid integration of Artificial Intelligence (AI) into educational technology promises to revolutionize content creation and assessment. However, the quality and pedagogical alignment of AI-generated content remain c…

Prompt Engineering

BAID: A Benchmark for Bias Assessment of AI Detectors

2025-12-12 · Priyam Basu, Yunfeng Zhang, Vipul Raheja arxiv

AI-generated text detectors have recently gained adoption in educational and professional contexts. Prior research has uncovered isolated cases of bias, particularly against English Language Learners (ELLs) however, ther…

An Automated Explainable Educational Assessment System Built on LLMs

2024-12-17 · Jiazheng Li, Artem Bobrov, David West, Cesare Aloisi 외

In this demo, we present AERA Chat, an automated and explainable educational assessment system designed for interactive and visual evaluations of student responses. This system leverages large language models (LLMs) to g…