paper-with-me

Papers

Knowledge-Based Trust: Estimating the Trustworthiness of Web Sources

2015-02-12 · Dong Xin Luna, Gabrilovich Evgeniy, Murphy Kevin, Dang Van, Horn Wilko, Lugaresi Camillo, Sun Shaohua, Zhang Wei

The quality of web sources has been traditionally evaluated using exogenous signals such as the hyperlink structure of the graph. We propose a new approach that relies on endogenous signals, namely, the correctness of factual information provided by the source. A source that has few false facts is considered to be trustworthy. The facts are automatically extracted from each source by information extraction methods commonly used to construct knowledge bases. We propose a way to distinguish errors made in the extraction process from factual errors in the web source per se, by using joint inference in a novel multi-layer probabilistic model. We call the trustworthiness score we computed Knowledge-Based Trust (KBT). On synthetic data, we show that our method can reliably compute the true trustworthiness levels of the sources. We then apply it to a database of 2.8B facts extracted from the web, and thereby estimate the trustworthiness of 119M webpages. Manual evaluation of a subset of the results confirms the effectiveness of the method.

📄 PDF Abstract BibTeX arXiv:1502.03519

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Evidence-based Trustworthiness

2019-07-01 · ACL 2019 7 · Yi Zhang, Zachary Ives, Dan Roth

The information revolution brought with it information pollution. Information retrieval and extraction help us cope with abundant information from diverse sources. But some sources are of anonymous authorship, and some a…

Information RetrievalRetrieval

To Trust or Not to Trust a Regressor: Estimating and Explaining Trustworthiness of Regression Predictions

2021-04-14 · Kim de Bie, Ana Lucic, Hinda Haned

In hybrid human-AI systems, users need to decide whether or not to trust an algorithmic prediction while the true error in the prediction is unknown. To accommodate such settings, we introduce RETRO-VIZ, a method for (i)…

Predictionregression

Evaluating Trustworthiness of Online News Publishers via Article Classification

2024-01-03 · John Bianchi, Manuel Pratelli, Marinella Petrocchi, Fabio Pinelli

The proliferation of low-quality online information in today's era has underscored the need for robust and automatic mechanisms to evaluate the trustworthiness of online news publishers. In this paper, we analyse the tru…

ArticlesClassification

Distilling Information Reliability and Source Trustworthiness from Digital Traces

2016-10-24 · Behzad Tabibian, Isabel Valera, Mehrdad Farajtabar, Le Song 외

Online knowledge repositories typically rely on their users or dedicated editors to evaluate the reliability of their content. These evaluations can be viewed as noisy measurements of both information reliability and inf…

TrustScore: Reference-Free Evaluation of LLM Response Trustworthiness

2024-02-19 · Danna Zheng, Danyang Liu, Mirella Lapata, Jeff Z. Pan

Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, prompting a surge in their practical applications. However, concerns have arisen regarding the trustworthiness of LLMs output…

Fact CheckingQuestion Answering