Navigating Nuance: In Quest for Political Truth
This study investigates the several nuanced rationales for countering the rise of political bias. We evaluate the performance of the Llama-3 (70B) language model on the Media Bias Identification Benchmark (MBIB), based on a novel prompting technique that incorporates subtle reasons for identifying political leaning. Our findings underscore the challenges of detecting political bias and highlight the potential of transfer learning methods to enhance future models. Through our framework, we achieve a comparable performance with the supervised and fully fine-tuned ConvBERT model, which is the state-of-the-art model, performing best among other baseline models for the political bias task on MBIB. By demonstrating the effectiveness of our approach, we contribute to the development of more robust tools for mitigating the spread of misinformation and polarization. Our codes and dataset are made publicly available in github.
Code (1)
Tasks
Language ModelingLanguage ModellingMisinformationTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
On the Relationship between Truth and Political Bias in Language Models
Language model alignment research often attempts to ensure that models are not only helpful and harmless, but also truthful and unbiased. However, optimizing these objectives simultaneously can obscure how improving one …
Language ModelingLanguage ModellingTruth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking
We present an analytic study on the language of news media in the context of political fact-checking and fake news detection. We compare the language of real news with that of satire, hoaxes, and propaganda to find lingu…
Fact CheckingFake News DetectionNavigating Dialectal Bias and Ethical Complexities in Levantine Arabic Hate Speech Detection
Social media platforms have become central to global communication, yet they also facilitate the spread of hate speech. For underrepresented dialects like Levantine Arabic, detecting hate speech presents unique cultural,…
Hate Speech DetectionAgainst Political Polarization: A Unified Framework for Tracing Evolving Political Ideologies on Social Media
The rapid growth of social media has greatly influenced political discourse, highlighting the need to understand individual political ideologies and their temporal dynamics. This task faces challenges such as data scarci…
Unsupervised Domain AdaptationStyle TransferFrom Text to Context: An Entailment Approach for News Stakeholder Classification
Navigating the complex landscape of news articles involves understanding the various actors or entities involved, referred to as news stakeholders. These stakeholders, ranging from policymakers to opposition figures, cit…
ArticlesNatural Language Inference