paper-with-me

홈 › Papers

Advancing Equitable AI: Evaluating Cultural Expressiveness in LLMs for Latin American Contexts

2025-11-06 · Brigitte A. Mora-Reyes, Jennifer A. Drewyor, Abel A. Reyes-Angulo arxiv

Artificial intelligence (AI) systems often reflect biases from economically advanced regions, marginalizing contexts in economically developing regions like Latin America due to imbalanced datasets. This paper examines AI representations of diverse Latin American contexts, revealing disparities between data from economically advanced and developing regions. We highlight how the dominance of English over Spanish, Portuguese, and indigenous languages such as Quechua and Nahuatl perpetuates biases, framing Latin American perspectives through a Western lens. To address this, we introduce a culturally aware dataset rooted in Latin American history and socio-political contexts, challenging Eurocentric models. We evaluate six language models on questions testing cultural context awareness, using a novel Cultural Expressiveness metric, statistical tests, and linguistic analyses. Our findings show that some models better capture Latin American perspectives, while others exhibit significant sentiment misalignment (p < 0.001). Fine-tuning Mistral-7B with our dataset improves its cultural expressiveness by 42.9%, advancing equitable AI development. We advocate for equitable AI by prioritizing datasets that reflect Latin American history, indigenous knowledge, and diverse languages, while emphasizing community-centered approaches to amplify marginalized voices.

📄 PDF Abstract BibTeX arXiv:2511.04090

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Evaluating and Improving Cultural Awareness of Reward Models for LLM Alignment

2025-09-26 · Hongbin Zhang, Kehai Chen, Xuefeng Bai, Yang Xiang 외 arxiv

Reward models (RMs) are crucial for aligning large language models (LLMs) with diverse cultures. Consequently, evaluating their cultural awareness is essential for further advancing global alignment of LLMs. However, exi…

Reinforcement Learning

Mind the Gesture: Evaluating AI Sensitivity to Culturally Offensive Non-Verbal Gestures

2025-02-24 · Akhila Yerukola, Saadia Gabriel, Nanyun Peng, Maarten Sap

Gestures are an integral part of non-verbal communication, with meanings that vary across cultures, and misinterpretations that can have serious social and diplomatic consequences. As AI systems become more integrated in…

Sensitivity

SESGO: Spanish Evaluation of Stereotypical Generative Outputs

2025-09-03 · Melissa Robles, Catalina Bernal, Denniss Raigoso, Mateo Dulce Rubio arxiv

This paper addresses the critical gap in evaluating bias in multilingual Large Language Models (LLMs), with a specific focus on Spanish language within culturally-aware Latin American contexts. Despite widespread global …

Assessing Socio-Cultural Alignment and Technical Safety of Sovereign LLMs

2025-10-16 · Kyubyung Chae, Gihoon Kim, Gyuseong Lee, Taesup Kim 외 arxiv

Recent trends in LLMs development clearly show growing interest in the use and application of sovereign LLMs. The global debate over sovereign LLMs highlights the need for governments to develop their LLMs, tailored to t…

Cetvel: A Unified Benchmark for Evaluating Language Understanding, Generation and Cultural Capacity of LLMs for Turkish

2025-08-22 · Yakup Abrek Er, Ilker Kesen, Gözde Gül Şahin, Aykut Erdem arxiv

We introduce Cetvel, a comprehensive benchmark designed to evaluate large language models (LLMs) in Turkish. Existing Turkish benchmarks often lack either task diversity or culturally relevant content, or both. Cetvel ad…

Grammatical Error CorrectionMachine TranslationQuestion Answering