paper-with-me

Papers

Political Ideology Shifts in Large Language Models

2025-08-22 · Pietro Bernardelle, Stefano Civelli, Leon Fröhling, Riccardo Lunardi, Kevin Roitero, Gianluca Demartini arxiv

Large language models (LLMs) are increasingly deployed in politically sensitive contexts, raising concerns about their susceptibility to ideological biases. In this work, we examine how synthetic persona conditioning shapes ideological expression across seven open-weight instruction-tuned models (7B-72B parameters) using the Political Compass Test (62 statements) as a standardized behavioral probe. Across three studies involving 200,000 synthetic personas and more than 260 million model responses, we analyze implicit and explicit malleability, as well as theme-associated variations. We find that: (i) larger models exhibit broader implicit ideological coverage, increasing from 14-35% for 7-8B models to up to 49% for 70B+ models; (ii) explicit ideological priming induces large and statistically significant shifts, with right-authoritarian cues moving all models in the intended direction and producing larger effects in most model-axis comparisons; (iii) left-libertarian priming produces more heterogeneous responses, including counter-directional economic shifts in three of four 7-8B models, while all 70B+ models move in the intended direction; and (iv) theme-associated semantic content in persona descriptions is linked to systematic and interpretable directional shifts in ideological space. While our results identify an upstream mechanism through which persona conditioning can alter model responses under a standardized ideological probe, we do not test whether such shifts affect users beliefs, decisions, or political behavior. Our findings are best understood as evidence of ideological malleability at the generation layer, highlighting the need to account for interactional factors when evaluating political neutrality, fairness, and safety in English-prompted, persona-conditioned language models.

📄 PDF Abstract BibTeX arXiv:2508.16013

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Against Political Polarization: A Unified Framework for Tracing Evolving Political Ideologies on Social Media

2026-08-18 · Yijie Xu, Chao Wang, Hui Xiong arxiv

The rapid growth of social media has greatly influenced political discourse, highlighting the need to understand individual political ideologies and their temporal dynamics. This task faces challenges such as data scarci…

Unsupervised Domain AdaptationStyle Transfer

Beyond Binary Labels: Political Ideology Prediction of Twitter Users

2017-07-01 · ACL 2017 7 · Daniel Preo{\c{t}}iuc-Pietro, Ye Liu, Daniel Hopkins, Lyle Ungar

Automatic political orientation prediction from social media posts has to date proven successful only in distinguishing between publicly declared liberals and conservatives in the US. This study examines users{'} politic…

Prediction

Ideology-Based LLMs for Content Moderation

2025-10-29 · Stefano Civelli, Pietro Bernardelle, Nardiena A. Pratama, Gianluca Demartini arxiv

Large language models (LLMs) are increasingly used in content moderation systems, where ensuring fairness and neutrality is essential. In this study, we examine how persona adoption influences the consistency and fairnes…

What Sounds ``Right'' to Me? Experiential Factors in the Perception of Political Ideology

2021-04-01 · EACL 2021 2 · Qinlan Shen, Carolyn Rose

In this paper, we challenge the assumption that political ideology is inherently built into text by presenting an investigation into the impact of experiential factors on annotator perceptions of political ideology. We c…

Mapping and Influencing the Political Ideology of Large Language Models using Synthetic Personas

2024-12-19 · Pietro Bernardelle, Leon Fröhling, Stefano Civelli, Riccardo Lunardi 외

The analysis of political biases in large language models (LLMs) has primarily examined these systems as single entities with fixed viewpoints. While various methods exist for measuring such biases, the impact of persona…