paper-with-me

Papers

A Survey on Automatic Credibility Assessment of Textual Credibility Signals in the Era of Large Language Models

2024-10-28 · Ivan Srba, Olesya Razuvayevskaya, João A. Leite, Robert Moro, Ipek Baris Schlicht, Sara Tonelli, Francisco Moreno García, Santiago Barrio Lottmann, Denis Teyssou, Valentin Porcellini, Carolina Scarton, Kalina Bontcheva, Maria Bielikova

In the current era of social media and generative AI, an ability to automatically assess the credibility of online social media content is of tremendous importance. Credibility assessment is fundamentally based on aggregating credibility signals, which refer to small units of information, such as content factuality, bias, or a presence of persuasion techniques, into an overall credibility score. Credibility signals provide a more granular, more easily explainable and widely utilizable information in contrast to currently predominant fake news detection, which utilizes various (mostly latent) features. A growing body of research on automatic credibility assessment and detection of credibility signals can be characterized as highly fragmented and lacking mutual interconnections. This issue is even more prominent due to a lack of an up-to-date overview of research works on automatic credibility assessment. In this survey, we provide such systematic and comprehensive literature review of 175 research papers while focusing on textual credibility signals and Natural Language Processing (NLP), which undergoes a significant advancement due to Large Language Models (LLMs). While positioning the NLP research into the context of other multidisciplinary research works, we tackle with approaches for credibility assessment as well as with 9 categories of credibility signals (we provide a thorough analysis for 3 of them, namely: 1) factuality, subjectivity and bias, 2) persuasion techniques and logical fallacies, and 3) claims and veracity). Following the description of the existing methods, datasets and tools, we identify future challenges and opportunities, while paying a specific attention to recent rapid development of generative AI.

📄 PDF Abstract BibTeX arXiv:2410.21360

Code (0)

등록된 구현이 없습니다.

Tasks

Fake News DetectionLogical Fallacies

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

User Experience Design for Automatic Credibility Assessment of News Content About COVID-19

2022-04-29 · Konstantin Schulz, Jens Rauenbusch, Jan Fillies, Lisa Rutenburg 외

The increasingly rapid spread of information about COVID-19 on the web calls for automatic measures of quality assurance. In that context, we check the credibility of news content using selected linguistic features. We p…

Latent Dirichlet Allocation with Residual Convolutional Neural Network Applied in Evaluating Credibility of Chinese Listed Companies

2018-11-24 · Mohan Zhang, Zhichao Luo, Hai Lu

This project demonstrated a methodology to estimating cooperate credibility with a Natural Language Processing approach. As cooperate transparency impacts both the credibility and possible future earnings of the firm, it…

Articles

Neural Network Architecture for Credibility Assessment of Textual Claims

2018-03-28 · Nurendra Choudhary, Rajat Singh, Ishita Bindlish, Manish Shrivastava

Text articles with false claims, especially news, have recently become aggravating for the Internet users. These articles are in wide circulation and readers face difficulty discerning fact from fiction. Previous work on…

ArticlesSemantic SimilaritySemantic Textual Similarity

Decoding AI Judgment: How LLMs Assess News Credibility and Bias

2025-02-06 · Edoardo Loru, Jacopo Nudo, Niccolò Di Marco, Matteo Cinelli 외

Large Language Models (LLMs) are increasingly used to assess news credibility, yet little is known about how they make these judgments. While prior research has examined political bias in LLM outputs or their potential f…

Fact Checking

Explainable assessment of financial experts' credibility by classifying social media forecasts and checking the predictions with actual market data

2024-06-17 · Silvia García-Méndez, Francisco de Arriba-Pérez, Jaime González-Gonzáleza, Francisco J. González-Castaño

Social media include diverse interaction metrics related to user popularity, the most evident example being the number of user followers. The latter has raised concerns about the credibility of the posts by the most popu…

Binary Classification