Inflating Topic Relevance with Ideology: A Case Study of Political Ideology Bias in Social Topic Detection Models
We investigate the impact of political ideology biases in training data. Through a set of comparison studies, we examine the propagation of biases in several widely-used NLP models and its effect on the overall retrieval accuracy. Our work highlights the susceptibility of large, complex models to propagating the biases from human-selected input, which may lead to a deterioration of retrieval accuracy, and the importance of controlling for these biases. Finally, as a way to mitigate the bias, we propose to learn a text representation that is invariant to political ideology while still judging topic relevance.
Code (1)
Tasks
RetrievalSimilar Papers 제목 키워드 기반
Does Topic Sentiment Cause Perceived Ideology? Comparing Human and LLM Annotations in Political News Articles
We ask whether topic sentiment has a causal effect on perceived political ideology, and whether the answer depends on who assigns the ideology label. Using articles from AllSides, paired with shared sentiment annotations…
Topic-Specific Sentiment Analysis Can Help Identify Political Ideology
Ideological leanings of an individual can often be gauged by the sentiment one expresses about different issues. We propose a simple framework that represents a political ideology as a distribution of sentiment polaritie…
ArticlesSentiment AnalysisPolitical Ideology and Polarization: A Multi-dimensional Approach
Analyzing ideology and polarization is of critical importance in advancing our grasp of modern politics. Recent research has made great strides towards understanding the ideological bias (i.e., stance) of news media alon…
ArticlesStance DetectionPolitical Ideology and Polarization of Policy Positions: A Multi-dimensional Approach
Analyzing ideology and polarization is of critical importance in advancing our grasp of modern politics. Recent research has made great strides towards understanding the ideological bias (i.e., stance) of news media alon…
ArticlesStance DetectionPredicting the Leading Political Ideology of YouTube Channels Using Acoustic, Textual, and Metadata Information
We address the problem of predicting the leading political ideology, i.e., left-center-right bias, for YouTube channels of news media. Previous work on the problem has focused exclusively on text and on analysis of the l…
Bias DetectionMultimodal Deep Learning