Factuality Checking in News Headlines with Eye Tracking
We study whether it is possible to infer if a news headline is true or false using only the movement of the human eyes when reading news headlines. Our study with 55 participants who are eye-tracked when reading 108 news headlines (72 true, 36 false) shows that false headlines receive statistically significantly less visual attention than true headlines. We further build an ensemble learner that predicts news headline factuality using only eye-tracking measurements. Our model yields a mean AUC of 0.688 and is better at detecting false than true headlines. Through a model analysis, we find that eye-tracking 25 users when reading 3-6 headlines is sufficient for our ensemble learner.
Code (1)
Similar Papers 제목 키워드 기반
Fact-checking information from large language models can decrease headline discernment
Fact checking can be an effective strategy against misinformation, but its implementation at scale is impeded by the overwhelming volume of information online. Recent artificial intelligence (AI) language models have sho…
Fact CheckingLanguage ModellingLarge Language ModelMisinformationTruth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking
We present an analytic study on the language of news media in the context of political fact-checking and fake news detection. We compare the language of real news with that of satire, hoaxes, and propaganda to find lingu…
Fact CheckingFake News DetectionPredicting Sentence-Level Factuality of News and Bias of Media Outlets
Automated news credibility and fact-checking at scale require accurately predicting news factuality and media bias. This paper introduces a large sentence-level dataset, titled "FactNews", composed of 6,191 sentences exp…
ArticlesFact CheckingSentencetext-classification+1A Survey on Predicting the Factuality and the Bias of News Media
The present level of proliferation of fake, biased, and propagandistic content online has made it impossible to fact-check every single suspicious claim or article, either manually or automatically. Thus, many researcher…
ArticlesBias DetectionFact CheckingFake News DetectionPredicting Factuality of Reporting and Bias of News Media Sources
We present a study on predicting the factuality of reporting and bias of news media. While previous work has focused on studying the veracity of claims or documents, here we are interested in characterizing entire news m…
ArticlesFact Checking