paper-with-me

Papers

Beyond Partisan Leaning: A Comparative Analysis of Political Bias in Large Language Models

2024-12-21 · Tai-Quan Peng, Kaiqi Yang, Sanguk Lee, Hang Li, Yucheng Chu, Yuping Lin, Hui Liu

As large language models (LLMs) become increasingly embedded in civic, educational, and political information environments, concerns about their potential political bias have grown. Prior research often evaluates such bias through simulated personas or predefined ideological typologies, which may introduce artificial framing effects or overlook how models behave in general use scenarios. This study adopts a persona-free, topic-specific approach to evaluate political behavior in LLMs, reflecting how users typically interact with these systems-without ideological role-play or conditioning. We introduce a two-dimensional framework: one axis captures partisan orientation on highly polarized topics (e.g., abortion, immigration), and the other assesses sociopolitical engagement on less polarized issues (e.g., climate change, foreign policy). Using survey-style prompts drawn from the ANES and Pew Research Center, we analyze responses from 43 LLMs developed in the U.S., Europe, China, and the Middle East. We propose an entropy-weighted bias score to quantify both the direction and consistency of partisan alignment, and identify four behavioral clusters through engagement profiles. Findings show most models lean center-left or left ideologically and vary in their nonpartisan engagement patterns. Model scale and openness are not strong predictors of behavior, suggesting that alignment strategy and institutional context play a more decisive role in shaping political expression.

📄 PDF Abstract BibTeX arXiv:2412.16746

Code (0)

등록된 구현이 없습니다.

Tasks

World Knowledge

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

An Empirical Exploration of Moral Foundations Theory in Partisan News Sources

2016-05-01 · LREC 2016 5 · Dean Fulgoni, Jordan Carpenter, Lyle Ungar, Daniel Preo{\c{t}}iuc-Pietro

News sources frame issues in different ways in order to appeal or control the perception of their readers. We present a large scale study of news articles from partisan sources in the US across a variety of different iss…

Articles

The Fallacy of Echo Chambers: Analyzing the Political Slants of User-Generated News Comments in Korean Media

2019-11-01 · WS 2019 11 · Jiyoung Han, Youngin Lee, Junbum Lee, Meeyoung Cha

This study analyzes the political slants of user comments on Korean partisan media. We built a BERT-based classifier to detect political leaning of short comments via the use of semi-unsupervised deep learning methods th…

Moral consensus and divergence in partisan language use

2023-10-14 · Nakwon Rim, Marc G. Berman, Yuan Chang Leong

Polarization has increased substantially in political discourse, contributing to a widening partisan divide. In this paper, we analyzed large-scale, real-world language use in Reddit communities (294,476,146 comments) an…

Articles

Balancing Transparency and Accuracy: A Comparative Analysis of Rule-Based and Deep Learning Models in Political Bias Classification

2024-11-07 · Manuel Nunez Martinez, Sonja Schmer-Galunder, Zoey Liu, Sangpil Youm 외

The unchecked spread of digital information, combined with increasing political polarization and the tendency of individuals to isolate themselves from opposing political viewpoints, has driven researchers to develop sys…

ArticlesDeep LearningSelf-Learning

Fine-grained Classification of Political Bias in German News: A Data Set and Initial Experiments

2021-08-01 · ACL (WOAH) 2021 8 · Dmitrii Aksenov, Peter Bourgonje, Karolina Zaczynska, Malte Ostendorff 외

We present a data set consisting of German news articles labeled for political bias on a five-point scale in a semi-supervised way. While earlier work on hyperpartisan news detection uses binary classification (i.e., hyp…

ArticlesBias DetectionBinary ClassificationClassification