paper-with-me

홈 › Papers

The Hidden Bias: A Study on Explicit and Implicit Political Stereotypes in Large Language Models

2025-10-09 · Konrad Löhr, Shuzhou Yuan, Michael Färber arxiv

Large Language Models (LLMs) are increasingly integral to information dissemination and decision-making processes. Given their growing societal influence, understanding potential biases, particularly within the political domain, is crucial to prevent undue influence on public opinion and democratic processes. This work investigates political bias and stereotype propagation across eight prominent LLMs using the two-dimensional Political Compass Test (PCT). Initially, the PCT is employed to assess the inherent political leanings of these models. Subsequently, persona prompting with the PCT is used to explore explicit stereotypes across various social dimensions. In a final step, implicit stereotypes are uncovered by evaluating models with multilingual versions of the PCT. Key findings reveal a consistent left-leaning political alignment across all investigated models. Furthermore, while the nature and extent of stereotypes vary considerably between models, implicit stereotypes elicited through language variation are more pronounced than those identified via explicit persona prompting. Interestingly, for most models, implicit and explicit stereotypes show a notable alignment, suggesting a degree of transparency or "awareness" regarding their inherent biases. This study underscores the complex interplay of political bias and stereotypes in LLMs.

📄 PDF Abstract BibTeX arXiv:2510.08236

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Enhancing Bias Detection in Political News Using Pragmatic Presupposition

2020-07-01 · WS 2020 7 · Lalitha Kameswari, Dama Sravani, Radhika Mamidi

Usage of presuppositions in social media and news discourse can be a powerful way to influence the readers as they usually tend to not examine the truth value of the hidden or indirectly expressed information. Fairclough…

ArticlesBias DetectionSentence

Do language models practice what they preach? Examining language ideologies about gendered language reform encoded in LLMs

2024-09-20 · Julia Watson, Sophia Lee, Barend Beekhuizen, Suzanne Stevenson

We study language ideologies in text produced by LLMs through a case study on English gendered language reform (related to role nouns like congressperson/-woman/-man, and singular they). First, we find political bias: wh…

Prioritize Economy or Climate Action? Investigating ChatGPT Response Differences Based on Inferred Political Orientation

2025-11-04 · Pelin Karadal, Dilara Kekulluoglu arxiv

Large Language Models (LLMs) distinguish themselves by quickly delivering information and providing personalized responses through natural language prompts. However, they also infer user demographics, which can raise eth…

PolBiX: Detecting LLMs' Political Bias in Fact-Checking through X-phemisms

2025-09-18 · Charlott Jakob, David Harbecke, Patrick Parschan, Pia Wenzel Neves 외 arxiv

Large Language Models are increasingly used in applications requiring objective assessment, which could be compromised by political bias. Many studies found preferences for left-leaning positions in LLMs, but downstream …

Steering Towards Fairness: Mitigating Political Bias in LLMs

2025-08-12 · Afrozah Nadeem, Mark Dras, Usman Naseem arxiv

Recent advancements in large language models (LLMs) have enabled their widespread use across diverse real-world applications. However, concerns remain about their tendency to encode and reproduce ideological biases along…