We Can Detect Your Bias: Predicting the Political Ideology of News Articles
We explore the task of predicting the leading political ideology or bias of news articles. First, we collect and release a large dataset of 34,737 articles that were manually annotated for political ideology -left, center, or right-, which is well-balanced across both topics and media. We further use a challenging experimental setup where the test examples come from media that were not seen during training, which prevents the model from learning to detect the source of the target news article instead of predicting its political ideology. From a modeling perspective, we propose an adversarial media adaptation, as well as a specially adapted triplet loss. We further add background information about the source, and we show that it is quite helpful for improving article-level prediction. Our experimental results show very sizable improvements over using state-of-the-art pre-trained Transformers in this challenging setup.
Code (1)
Tasks
ArticlesTripletSimilar Papers 제목 키워드 기반
Predicting the Leading Political Ideology of YouTube Channels Using Acoustic, Textual, and Metadata Information
We address the problem of predicting the leading political ideology, i.e., left-center-right bias, for YouTube channels of news media. Previous work on the problem has focused exclusively on text and on analysis of the l…
Bias DetectionMultimodal Deep LearningInflating Topic Relevance with Ideology: A Case Study of Political Ideology Bias in Social Topic Detection Models
We investigate the impact of political ideology biases in training data. Through a set of comparison studies, we examine the propagation of biases in several widely-used NLP models and its effect on the overall retrieval…
RetrievalMulti-Task Ordinal Regression for Jointly Predicting the Trustworthiness and the Leading Political Ideology of News Media
In the context of fake news, bias, and propaganda, we study two important but relatively under-explored problems: (i) trustworthiness estimation (on a 3-point scale) and (ii) political ideology detection (left/right bias…
ArticlesLearning Unbiased News Article Representations: A Knowledge-Infused Approach
Quantification of the political leaning of online news articles can aid in understanding the dynamics of political ideology in social groups and measures to mitigating them. However, predicting the accurate political lea…
ArticlesFiltering Context Mitigates Scarcity and Selection Bias in Political Ideology Prediction
We propose a novel supervised learning approach for political ideology prediction (PIP) that is capable of predicting out-of-distribution inputs. This problem is motivated by the fact that manual data-labeling is expensi…
Selection bias