paper-with-me

홈 › Papers

Occupational Prompting Reveals Cultural Bias in Large Language Models

2026-05-19 · Maksim E. Eren, Andrea Brennen, Ryan C. Barron, Eric Michalak arxiv

Social roles shape expectations, priorities, and judgments, yet it remains unclear how large language models (LLMs) associate occupational identities with broader cultural value patterns. Prior work used nationality-based cultural prompting to study how LLM responses to value-survey questions align with human cultural benchmarks. In this paper, we extend that framework by replacing cultural prompting with occupational prompting to examine how professional-role cues influence value-survey responses in open-weight LLMs. Using a survey-grounded evaluation pipeline based on questions from the Integrated Values Surveys, we project model responses into the two-dimensional Inglehart--Welzel cultural space. We prompt open-weight LLMs to answer questions under occupational identities such as accountant, teacher, engineer, and nurse, and then analyze how these occupation-conditioned responses are positioned on the cultural map. Our results show that when open-weight LLMs are prompted with occupations rather than national identities, their responses remain within a broadly Western-leaning region of the cultural map. However, different occupations introduce shifts within this region, producing distinct occupational skews. This indicates that occupational prompts are not treated as neutral role labels, but instead elicit structured value patterns. These findings extend survey-based evaluation of cultural bias beyond nationality-based prompting and provide a framework for studying how occupational personas shape value expression in LLMs.

📄 PDF Abstract BibTeX arXiv:2606.12443

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Can we Debias Social Stereotypes in AI-Generated Images? Examining Text-to-Image Outputs and User Perceptions

2025-05-27 · Saharsh Barve, Andy Mao, Jiayue Melissa Shi, Prerna Juneja 외

Recent advances in generative AI have enabled visual content creation through text-to-image (T2I) generation. However, despite their creative potential, T2I models often replicate and amplify societal stereotypes -- part…

Bias Detection

Causally Testing Gender Bias in LLMs: A Case Study on Occupational Bias

2022-12-20 · Yuen Chen, Vethavikashini Chithrra Raghuram, Justus Mattern, Rada Mihalcea 외

Generated texts from large language models (LLMs) have been shown to exhibit a variety of harmful, human-like biases against various demographics. These findings motivate research efforts aiming to understand and measure…

Benchmarking

Generating the Modal Worker: A Cross-Model Audit of Race and Gender in LLM-Generated Personas Across 41 Occupations

2025-10-23 · Ilona van der Linden, Sahana Kumar, Arnav Dixit, Aadi Sudan 외 arxiv

As generative AI tools are increasingly used to portray people in professional roles, understanding their racial and gender representational biases is critical. We audit over 1.5 million occupational personas generated b…

Cultural Bias and Cultural Alignment of Large Language Models

2023-11-23 · Yan Tao, Olga Viberg, Ryan S. Baker, Rene F. Kizilcec

Culture fundamentally shapes people's reasoning, behavior, and communication. As people increasingly use generative artificial intelligence (AI) to expedite and automate personal and professional tasks, cultural values e…

AfriStereo: A Culturally Grounded Dataset for Evaluating Stereotypical Bias in Large Language Models

2025-11-27 · Yann Le Beux, Oluchi Audu, Oche D. Ankeli, Dhananjay Balakrishnan 외 arxiv

Existing AI bias evaluation benchmarks largely reflect Western perspectives, leaving African contexts underrepresented and enabling harmful stereotypes in applications across various domains. To address this gap, we intr…